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PREFACE ^ / 

4 * 

This monograph is part of a seriaa 'of eight, 
commissioned by the National Institute of v Education 
(NIE), following recommendations presented in Seven 
Years Later; Wotnen'^s Studies Projtrams in 1976 by 
Florence Hove. 

Seven Years Later was Qommissioned and published 
by *the NatlJnal Advisory Ceuncil on Women^s Educa- 
tional Progmos. It was the first federally financed 
investigation of women'fe studied.* Howe vfsited and 
reported oq 15 mature wdmen's studies programs, in the 
context of . national Vrdinds and directions within 
women's s^tudies. ^She/focused on some areas (funding 
*and faculty, for ^^mple, in >'-yeaf colleges a*nd 
universities^ and ft^<f^uded others (community colleges, 
for example) entirely. * ^ 

m , r 

f 

The eight new monographsr take up some of the 
questions Howe explored; they also initiate explora- 
tions of untouch^ areas^. All are coocfferned prim|irj.ly 
wtth higher education. ■ " * 

Each monograph review^ literature relevant to its 
focus produced durlTng this;, first decade of women's 
studies. Each also «attempts to provide definition t o ^ 
a field in th^ process <!^f development, a complex 
interdisciplinary area^ of scholarship and- curriculuta 
that is also u strategy foy educational change. 
Bdjfond' definition, kach monograph recommends research 
essential for the future development of women's 
studies and important to educational Research more 
broadly. ' . j 

While proGru6indn:hese eight - monographs , the 
researchers met for 2 qays to compare perspective's and 
conclusions. As a group, ve agreed to offer ioixr 
Jcormal recommendations to the National Institute of 
Education and to all other Federal agencies and 
private f&undationd that might pursue and support 
research and development in women's studies. 



H fie need f^r future, monographs . We recognize 
the impprtance of ; eontinuinfii the development 
of inforffiatlon' alabut - relatively unexplored 
aspects of women's studies. Among those 
aspects that need examination, the following 
are especially important;: 



a. 



Graduate programs and graduate education 
in women's studies. 



b. Schools of education and women's studies 
activities » 



c 



Women's studies in the elementary and 
secondary schools. * * - 



d. Noncredit curriculum development in 
women's centers, continuing education for 
women, and community -based centers. 

' 2. The need for a. data base on w omen^s studies. 
All eight monographs recomntend the develop- 
ment' of a data base on women's studies as a 
necessary prelude to research design and 
^ activity. Since women's studies has^evel- 
oped in different ways and at different 
rates on almost all cdmpuses throughout the 
country, such a data base must be Um&y- 
tudinal in design. While we are recommending 
its development in higher education, such a 
data base eventually will need to be extended 
to all areas. of 'education. We recommend that 
annual updates, be built into the data base to. 
• ensure its proper maintenance and Continued 
usefulness. 

3. The qualifications of resear« 4t-^p?rsonnel in 
women's studies . We believe that . the dis- 
tinctvive and complex ^nature of women a 
studies, as well as the fact that it fs still 
a developing field, makes it essential that 
researchers 'be thoroughly infor^ied about 
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• women's* studies and be prepared to involve 
women' s^atudles practitioners In every aspect 
xjf research deBtgn * and proKess • We a re 
'hopeful that N1*E and other Federal' agencies, 
private foundations, and re£^earch instltu- 
C4ons will place resijonslblllty for research 
ifi^Women's st\idles *in the hands of those 
experienced and k^owledgea^ble? about the 
area. ^ 

4. Considerations significant to evaluation 
research and methodoloj^V i We Relieve that 
the evaluation of women's studies In. higher 
education will be an Itaportant. actly|.ty of 
tKe coming decade. Such evaluatlbn will- 

• serve the researcher , Interested In the 
processes of changing higher education, ad 
well as those charged with a^dmlhlstering 
Institutions^ Sjuch evaluation should, on 

^principle, also* clearly serve, the develop- 
mental^ needs of women's studies programs, 
engaging them In the design and processes of 
research, as well aS In the determination of 
the uses to' which research will be put. 
Evaluations should be conducte;d onslte, wlb^ 
• t^e cooperation tff program participants, and 
within a framework of longitudinal data about 
that program and others nationally. Re- 
searchers and ^evaluators should be sensitive 
I to the work of the Natlona'l Women's StudJ.es 
Association In this regard, and Its activi- 
ties serving the tieeds of women's studies 
programs. 

tailed,* further recommendations appear in each of 
eight mqndgraphs. 
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A 

This planning stu<ly reviews ^ thfe ' literature on 
teaching effectiveness in^ women's studies in the 
context of sever'al infe^r/ative studies in research on 
teaching- and researc^i on the evaluation of teaching. 

To date, the experimental research in women's 
studies hais^. for the- most part, concentrated on 
assessing changes in attitude toward sex roles and 
sex stereotyping as the appropriate objectives for 
measuring teaching effectiveness in women/s studies* 
We suggest that cognitive^ develdbment, *an area that 
has not been* addressed in the lirtrature, .is /at l^ast 
as important as attitude change. An-approach to 
research and evaluation that acknowledges the inter- 
action between students, teachers, a/tid the subject 
matter and sieeks to estabiisfi relationships between 
multiple variables that ^obtain ' in teaching and learn- 
ing Is recommended. 

We propose both long- and short-range goals in 
research* These include research that will contribute- 
to a knowledge base and acquaint the larger educa- 
tional cpmmunity with women's^ ^studies approaches to 
teaching and learning, as weil as formaxlve studies 
^ that will be of direct use* to women's sl^udleS ^rac-? 
I titioners. * , * \ 

Nanty M. Porter 
Portland State University 

I Margaret T. ElleenchUd 
Harvard Graduate School of Education 
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1 « INTRODUCTION 



^ Thinking about the questiohs of effective teach- 
ing in wpm^n^s studies has led us to consider two more 
Jjasic questions: What is teaching? .What is learning? 
Both questions inevitably lead back to: What \s' 
education?. . 

, Our philosophies of- education, as^^men's studies 
teachers, students, and administrators, influence 
our notions of what we might want to teach ox. study, 

•why we might want to teach or "study one thing over 
another,, how we might go about the process- of teachJjig 

•and learning, and to what ends oujr instruction 
and study might be put.* Teaching and learning, 
whether , effeecCive oiT , ineffective, are the interplays 
between the\ S|£ib ject matter (the whats and whys), the 
approaches Vthe hows), and the purposes (the. ends). 

Questions of teaching effectiveness, in or out 
of women's s.tudies, are embedded in the various phil- 
osophies of- educatioij that influence and socialize 
both teaching"^ and learning. The objectives of teach- 
Ihg, learning., and evaluation re,search ultimately 
trace l^ack to the articulated and jinarticulated phil- 
osophies irom which the various objectives arise. And* 
the methodologies for assessing effective teaching are 
linked to the varying and sometimes conflicting objec- 
tives held by students, teachers, and researchers. 

The Uterature thalg;' s\i;Vounds the "d'ev^opment^ of 
women's studies courses and programs often emphasizes 
the unique promise of th^ field. clven ehi*, it 
Should be realized that women's studies shaifea in. at 
least three traditions of higher education in the 
United Statiesf progressive or relevant 'education; the 
fostering of scholarship; and the preparation of 
'students for careers and professions. 

By relevant or progressive, w& mean education 
that is viewed as thd "fundamental method of social 



progress and reform," a process that integrates the 
psychological and the sociologicar in cognition md 
affect, and a curriculum that moves in the "positive 
direction of providing a body of subject matter" that 
is "richer, more varied and flexible" than the, tradi- 
tional when "judged in terms of the experience of, 
those being educated" (John Dewey, 1897). 

By the fostering of scholarship, we mean the 
interpretation, criticism, and communicatriijn of the 
accumulated knowledge of a number of disciplines^ as 
well as the generation of new knowledge within and 
across the disciplines. And by the preparation of 
students for work and the professions, we mean the 
particular emphasis given to thfe ^ creation of oppor- 
tunities within the general curriculum for students to 
explore possible fields of work, as well as the 
opportunity to acquire specific knowledge and skills 
useful in career and professional* development. 

Women's studies , as an emerging discipline, 
Overlays these .traditiona-1 conce.rns wit^ an em- 
phasis on feminism and, in .theory at least, an 
interdisciplinary perspective in the interpretation 
and criticism of the accumulated knowledge of a, 
number of academic disciplines and within women's 
studies itself. Women'-s studies is also a political 
phenomenon in that it is viewed #by many of its practi- 
tioners as an outgrowth of various social change 
movements of the 1960's, particularly the women s 
liberation movement. 

Feminism, as we use the term in the context of 
the classroom, is the desire to increase the power a\d 
autonomy of women as individuals and as a group 
thrbugh instructional processes that enable them to 
acquire knowle^dge and skills to make informed, flex- 
"Stble choices in their educations and their lives. 
Feminism, in this sense, may be viewed either for its 
own sake or as a way station on the road to a more 
responsible and informed humanism. 



In an eKtension of the c}efini4:ion of "inter- 
disciplinary" offered in Signs (1975), we^ use this 
term to mean an approach to subject matter aAd" course, 
'diesign in whicii one person skilled In several d^ciy 
^pline^ pursues one subject, or several teachers each 
skilled in a single disc ipl Ine explore a single 
subject together (YateS,- 1977), or students aad 
teachers together us^ riethods and information from the 
research or scholarship of multiple* disciplines^ A^d 
by pof itical , we mean not only the field of wofiien's 
stu*dieis viewed as the academic arm of the women's 
movement , hxXt ,,the process by which women's studies 
teachers and students strive to make their classes a 
mediation between what has, been and is and what is' and 
what might be in education, culture, and society*. 

^ It is this overlay of feminism, the interdisci- 
plinary, and the political that makes the assessment 
of teaching and learning, and .the structures in which 
they take place, relatively problematic for the 
participant and the observ^fer who have been trained in 
♦more conventional modes. 

Because the definition and assessment of teaching 
effectiveness in women's studies is complex, it ha^^ 
seemed^ worthwhile to us to in^rfeuce the published,, 
unpub lished ,< and informal literature of ^omen's 
studies with discussions o% tfie status of research' on 
t^^^ching and or^ the eval*uation of teaching. Our. 
recommendations for . fur 'ther research in the evaluation 
of tjaaching and learning' in women's studies, ape drawn 
from this comprehensive body of research. 

Finally, in an eff</rt Jto^ establish a^^Pre compre- 
Jarensive statement of the values of women's studies 
teaching that is; the goals of women's studies 
teaching that inform specific course objectives — we 
have surveyed women's studies teachers across the 
country. The resirlts of this survey are included in 
an aj>pendix to this monograph. ^ 



2> RESEARCHjON TEACHING 



Overview 



Jiesearch on teaching has a respectable longevity, 
_at least in the United Statfes. The earliest research, 
reportied by Do;yle (1975), was an 1896 study concerned 
with the factors that contribute to effective teach- 
ing. ,v ^ - 

Dublh and Traveggih (1968) report fr6m a 1924 
8-tudy^ entitled "The Lecture vs. the Class Discussion 
Method of "College Teachings" that differences in 
method, produce' no significant differences In student 
learning as meastired by fijaal examination scores. 
Dubin and Traveggia reviewed 90 additional studied and 
concluded that no one' teaching jnethocf^s superior to 
another when stucfent learning is meas^ed by exmnlna- 
tion scores.^ They point out, howeler, th^ these 
scores do not reflect all of the learning that takes 
place during a course and that edocat'lohal goals such 
as personal and intellec^tual development ar^ also 
inq>ortant . 

Dubin and Traveggia's unequivocal conclusion 
notwithstanding, the volume of Research in the area of 
effective teaching, and . particularly research related 
to effective teaching at the college and univeieity 
level, is' enormous and growing. This growth may be 
fitttributed to the" cumulatlye ^effects of an ex^an^lng 
knowledge And data base, to the movement for account- 
ability in higher education, and to this movement's 
offspring, faculty development, which has the improve- 
ment of teaching as a major component. 

; The literature oti effective teaching Is so vas^ 
(G^ge, 1972) that even a cursory review is beyond the.; 
scope of* this planning study. However, we believe 
that it is useful^ to review below four integrative 
papers^ that are concerned with conceptual rather than 
methodological problemSsjd.n research on teaching.- Such 



seems an appropriate strategy since the state of tKe 
literature on the ef fectjj-veness of women's studies 
teaching is at the conceptual stage, as will be seen 
in section 4» * ^ a . 

The State of the Art , , * 

As Biddle (1964), Smith (197U'; and Doyle (1975)<, 
'respectively; point out, there W pnoblems with the 
"facts" of teachi'ng effectiveness, thfe/'^concepl^s , and 
the rielationship between teaclv4^ and learning* 

..Biddle comments that,' in the "literally tV^ousands • 
of studies. . .few if any 'facts', seem to ha>;^e;been 
established concerniiig teaching effectiveness, no 
Hjethod of "measuring conq>eteilce has been approved^ aAd 
no methods of promotitfe teacher adequacy . have been 
widely adopted." With respect to the concepts of 
teaching effectiveness, Smit4i note^: "Despite all of 
our efforts, we apparently^ have- no generally accepted 
conceptual system, psychological or otherwise,, by 
which ^eithe'r to formulate or to identify skills of 
teacliing." , 

And Doyle concludes that the nelattonshlp between 
teaching and framing eludes the researcher. Efforts 
to achieve a "cumulative integration of research 
findings -have. With remarkable regularity, failed 
to support the existence of stabfflLe and consistent 
relationships between teacher variables and effective- 
ness criteria." Although Doyle finds some cause for 
"cautious optimist" in the findings of Flanders and 
Simen (1969) and Gage (1972), he warns that pa8.t 
experience in thik area strongly suggests that estab- 
lishing- stable teacher effectiveness relationships 
will not be easy." \ ^ 

Biddle; Variables in Effect ive Teaching ^ 

Biddle. (1964). begins his i:eview of research 
on the effectiveness of teaching with a conceptual 



discussion of the basic variables involved in' effec- 
tive teaching. - Defining teacher effectiveness^ as 
an '^individual teadher^s ability to produce agreed 
upon results," the author offers a model that includes 
seven variables that should be considered „inresearch 
on teaching effectiveness: (1) ^;he forfjfetlve exper- 
iences of the teacher — educational background, 
soci^alization, sex, age, or race; (2) the teacher 
"properties," that/is, the specific skills, know- 
ledge, or motives that *the '^teacher brings to teachr 
,ing and learning; (3) the teacher "behaviors," that 
is, teaching style, responsiveness to students, 
mannerisms, and so on;' (V) the* immediate effects o£ 
formative experiences, f>ropertie8, and behaviors oii 
students; (5) the long-term effects of the first four 
variables on students; (6) the classroom environment 
itself, ^bothp the make-up of the class and the |>hyslcal 
environment; and (7) the institutional or community 
context in which teaching and learning take place* 

Biddle suggests^ possible methods for measuring 
the seven v^aifiables, including observational tech- 
niq^es, student ratings, ^achievement tests, and the 
self-reports of students^ He calls flpr the integra- 
tion of the research on teaching, stating' that the 
measurement of variables has become confused with the 
variables themselves. He contends that all of the 
variables must be coilsldered if the confusion is to be 
reduced and if we are to uncferstand the complexity of 
the problem. 

J ^ : ■ 

Biddle^s concerns that there mUst be agreement 
about* objectives, that both the short- and long-teni 
effects of instruction on- students, as well as the 
Institutional andA>r 'community context, must be talcen 
into account, and that variables must be integjrated 
are particularly useful jLn conceptualising research 
otni^he eff ectiv^eness of teaching in^women^s studies. 
However, he fails to Include the learner as an 
Important variable in the process of me^asurement . 



Henderson 'and Lanier; Val^e oi Teach er's Goals 

Henderson and Laaler (1972) focus on the lack of 
conceptualization of effective, teaching and th* 
consequent absence- of syst6mization in' the ^ research. 
'Their work .is unique in that they propose assessing 
the' value of the teacher's go'als or objectives, that 
^ isl the purpose I of the content of\the instruction. 

Hendetson and Lanier discufes the social responsi- 
bility of teachers ^s an important variable in 
asi^essing ef f ectiveness r However extcAne, .the follow^ 
ing example .illustrates the :> point. ;If the etjd of a 
, course in atpmic p\y8ic8 were t6 enable individuals to 
build an /.atomic' bomb i th^n tegarti less ■ of the means 
employed, no matter how well the cour^e^ was taught, 
the result would not be effective teach;Lng. As we 
know, many'sekist and misogynist courses are v^ry well 
* taught. ... 

Dovlfe; "Process-Product" Paradigm 

,. * Doyle ( 1975) "uses Kuhn's (1970) concept of 
paradigm (a framework that inclufles the questions that 
are asked in a particular field, the methods that are 
used to ask the questions, and the tools that are used 
to evaluate the answers) to define the approach most 
widely used in the research on teaching a(^ctivenes-s : 
the "process-product" paradigm. Doy if Argues con- 
vincingly, that questions of' teachJ(.ng effectiveness 
must be reformulated Within alternative paradigms if 
'researchers are to do more than continue to produce 
negative or nonsighif leant results. The production of 
the^e negative or ■ nonsignificant results dominates 
^ the research on teaching effectiveness in general and, 
as discussed in section 4, in women's studies in 
particular. 

' Operationally, the ''process-prod^ict paradigm 

' focuses on isolating stat^istical associations between 
the frequency of specific teacher behaviors {the 
independent variable) and changes in class mean scores 
(the dependent variable), Although ^ good deal of the 

t . 

* • • 8 * , 

o \1G • 

ERIC . . ^ 



research is of thfe, descriptive, cprrelational variety, 
there is an acssumption ^within the paradigm th§rt the 
behaviors of teachers tiave a causal impact on the 
behavior of Qtudefft^. Not only is this assumption 
of causafliXy not warranted f r^om the dat:a available, 
Doyle p6ints^ mit that ^ome of' the research actually, 
indicatfss that/ the' behavior of* students is the cause 
of Xhe behavior of teachers. . 

Doylfe suggests two alt€f^nat ives to the process-' 
, product paradigm: the student mediating process (or 
prqcesffe-process)*^ paradigm, and the "culture . of \the 
school" paradigm. ^oth have Important implications 
.for the, assessraernt of teaching "i^f f ec t iveness ^in 
womien's studifes. , , V 

■ : • • . V ■ J. ' 

In the student mediating paradigm, variations in 
t|ie--outcomes of student learning are viewed as a 
funt:tion of the, mediating^ processes employed by the- 
students during the learning process itself. The 
mediating process is influen^ted in part, iKit not 
exclusively, by instruction. This paradigm' moves the 
student* from the passive, acted-upon role assumed in 
the process-proi^Uct paradigm into the arena b3 an 
inDferactor. Such variables as the ability dnd cog- 
nit ive'styles of the studenj:s mediate- between the 
teacher and the outcomes of €he learning.* 

*A note on terminology The terms 

learning style ^and coghitive style are sometimes used 
interchangeably in the literature. / As we* use the 
term, however learning style is to be interpreted as 

. defining the behaviors of ^students that are related 
primarily to personality and that can be obse^yfed or 
infejrred from behavior. For Ijistaace, a -student may 
be a cooperative, a compliant, a Jafghly -motivated or 
a competitive learner. Cognitive style refers to 
tho^e aspects of thinking that ara, f or the most 
part, not observable but are preferred styles'of 
inf ormai;^ion-seeking and information-processing, in 
solving problems (Cpgp and Slgel, 1971)» Fseize 
et al.-(197^) offer a current discussion of sex dif- 

^ ferences in cognitive style. * • * 



' ' * Not- only does the process-process paradigm 
reflect more accurately the reality of the classroom, 
it could "be expanded to Include the student learning 
that tSces place outsldfe ^f the classroom as w^ll. We 

« need to be reminded thaL-the-'classroom Is oi^^y one 
component of a course: It provides a context for the 
reading, discussion, thinking, and w^rlting , that go ove 
'outside (Stizel, 1977). Further, in' women's studies, 
students sometimes engage in field work, and som^ 

■. actively participate i^u program maintenance , including 
service on^ cur riculum committees and teaching. These 

' activities Ved tQ be, considered in understanding^ the 

,•• • complex influences on the tlassroom. ' , 

The" bidirectional' apptoach/of' the processTproce6s 
'paradigm Is impottani: to reseaW on teaching effec-^ 
tlveness in women's studies, particularly as.it 
^relates to tli? behavior of students on such variables 
as competence, motivation, and enthusiasm, which, iii 
turti; influence the teacher and affect the process 
of teaching and learning. And as - an additional 
• cpnsideration, because the majority of women s studies 
. teachers and students are female, current research on 
women as lekmers, both in terms df learning and 
cognitive styfes, should be taken into account in 
further Research in this area. 

' Doyle's second alternative hypothesis, the 
culture of the school paradigm, includes classroom, 
variables not - connected specifically to the 'behavior 
of teachers or students. Rather than isolating 

* variables, this paradigm focuses on ' the use of the 

* ^■■inductive-obsert/dtional method /o record^ and analyze 

the full range of variables ■irifluencing a particular 
'class. Often u^ed for formulating ' hypotheses, .this 
method seems an appropriate methodology for women s 
studies at this time. As noted in section 4, the 
, descriptive reviews, case studies, and personal 
narratives of women'* studies teachers and students 
are useful in conceptualizing th6 variables o£ effec- 
" tive teaching in women's studies. 
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Wlnne and Marx: Reconceptuallzatton of Research 

^^^^ ' ^ ^ ' ^ ^ " ' ^ 

Wintt^ and Marx (1977) build on. Doyle's process-* 

' process paradigm and further support Doyl^i's-^ analysis 
t\iat th|5T^ are serious conceptual and metljbdologlcal 
problems \iith de8cri|)tive ^trelational and experi- 
mental research that looks for cajusal _f elationships 
>^ between the behavior of' teachers and the learning of 
^ s tudents / They p ropose a r econceRtualization of 
^ research bn teaching to include variables that 
^ describe "how one learns." They furthe^ propose that 
these variables should appj.^ to students and teachers. 
^ gilike* In their view, "an adequate knowledge about' 
teacher effectiveness e^nnot develop without consider-, 
ing the mental li^e of teachers and students*" • 

WinnV and Marx see the teacher as primarily, 
although not exclusively, 'responsible for communi- 
cating. Such communication invcTlves choices about 
the s^tructure of the subject matter, the cognitive 
%nd learning style3 of the teacher, and "dynamic 
decisionmaking"* on the p^rt of the teacher^n the 
classroom. Students are* primarily, but not exclu- 
. sively, responsible for acquiring skills and know- 
ledge, and this also involves the cognitive And 
learning styles and the dynamic decisionmaking of the 
udents. . ' 



Although the authors call for Research that takes 
into account the mult^ivariate and bidirectional nature 
of the teaching and learning process, they acknowledge 
that making these concepts operational is difficult. 
Cognitive processes can only be inferred from be- 
havior > and the extent and actual structure of 
what one learns or how one thinks whether as 
teacher or as student is nearly impossible to 
qufintify. Nevertheless, the approach of Winne and 
Marx is useful for providing a coQq>rehensive framework 
for the analyses, *case studies, and descrip-tive 
research in women's studies. Their model suggests 
that stCfdents and teachers share responsibility for 
the quality of the teaching and learning process. 
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As a final note, Witine and Marx view the choices 
of subject matter that teachers make within a frame- 

work that preserves the "structure of the subject" 

(Byuner , 1963) • , In women's studies, the body of 
kjiowledge is developing rapidly, and teachers and 
students are faced with a knowledge explosion^ The 
body of knowledge is also becoming mpre organized, and 
the curricular materials more sophisticated* The 
decisions that teachers mafke, therefore, about the 
design and organization of a couriSe pr a curriculum 
are also dependent upon the body of knowledge that is 

^ available. And this in turn influences teaching j4 
effectiveness. 



3« EVALUATION OF TEACHING * ^ V 



Overview v 

Redearch paradlgmSt at ^least of th§ conceptual 
rather than the methodological variety, favpr a 
multivariate and bidirectional approach to under- 
standing and assess^lng effective teaching and ^earn- 
ing. Conceptual papers on the evaluatioi^ of teaching 
also take a compr ehetisive approach. The position 

^aper^ of the American As-sociation of University 
TProfessors (AAUP, *1974)^calls for the use of multiple 
measures to assess the effectiveness, of ipstruction* 
Measures of student learning, . student ratlii^s of 

« instruction, student and alumni Interviews, classroom 
visitation by peers, iilstructor self-evaluation, and 
outside expert evaluations ail are ' recommenced* 

Howev.er , most^ colleges and -universities relv 
solely on student ratings for the evaluation or 
teaching « Although the research on teaching suggests 
that looking for correlational or causal relationships 
between the behavior of teachers and the achievement 
oi^ Students has not been particularly fruitful, the 
wide use of student ratings necessitates a review of 
current attitudes toward the reliability, validity, 
and usefulness of these ratings* 

Termiilologles, assumptions, and some confusion 
inherent in the studies reported on in this Section 
need to be articulated* Reliability, for the most 
part, refers Jjoth to the ext'^Bnt to which an Instrument 
is consistent in measuring objectives aAd to tlie 
consistency of the ^student raters* Validity /NLgi most 
instances, does not refer to the validity of the 
instrument used* Jnst r^iii^nts in these' studies have 
been factor analyzed' and validated* Validity, then, 
refers to the ability of the students tp assess 
^validly the objectives and properties that are assumed 
to characterize effective, teaching* , However, because 
it is often difficult to agree' upon what is to be 
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meaiured aad because different courses may have 
different objectives (and adaptations of Instruc- 
tional format - ta^meet xhieae iah^eiitlvea)^ Jl 
validity^ are often pro^Iefl»atlc#::!/'^^A8 Talbuytt et al. 
(1977) comment, students Ise em ' less adept at assessing 
the piitcomes of Innovative as opposed to* conventional 
'Courses' or educational experiences* 

We also 'need to be aware that.all^ of the work 
reported on Is correlatloftaj. and indicates relation- 
ships- between variables. , As the adage gbep, .however, 
•cTorrelation does, not imply causation. ^Similarly, 
the /research assumes existence of- 'universal 

characteristic^ of effetstive teaching thAt cross and 
eiicompass the various academic disciplines » so tliat 
results" from an economics claims can be compare4 ^th 
.results Jf rem a cla^s in French language or ' one in 
educational psychology. Although Feldman and Newcomb 
(1969) indicate that students and teachers associated 
with different academic fields tend to have differeai: 
values and characteristics of personality, Socklaff 
and Papacostas (X975) state that the discipline does 
not Influence qualities of effective teaching. For 
the most flpart, researchers in the area assume the 
latter position. 

Usefulness of student ratings is a mixed concept. 
Student ratings are sometimes -used for either f<^rma- 

,tive or summative evaluation.* Centra (1972) reports, 
however, that fonnative ratings do little, if any- 
thing, to Improve teachings in the Short tun. We have 
found nd studies describing the long-term effect of 
student ratings on the improvement of instruction. 

* Centra hypothesizes that student ratings tend to tell 
the teacher what she or he already knows. 

^Formative evaluation is intended to mq^flify or 
improve Instruction during a course. Summative 
evaluation is conducted at the etnd of ^he course, 
with the purpose of improving ^teaching in the 
future. 

* 7 
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Of ten 9 student ratings are used for a x^bmblna*^ 
tlon of purpod'e^^ , In ^dltlon to the improvement of 
t^aching^ These Include making personnel or -adm,tnisr>__ 
trative 'declsloi]i|s and p^^ldlng lnfoi:matlon for 
students ^l];i;^ahooslng classes and Instructors* ^ In Some * 
Instances, student ratings mei^ely take up space in 
Inactive lies. 

Confusion clouds t;he literature when It- oecomes 
unclear whether^ thiS student rating forms measujte the 
effectiveness of the teacher, the effectiveness off 
the classroom experience, or the effectiveness 'of 
the course as U whole. For example, if a student 
radicates *"lncreased Interest In the subject," the 
stud4.es do n6t Indicate- whether tjhis -Interest ' Is 
related to the enthui^lasm or &k'lll of thh teacher, the 
composition of thfe class, the background of the other 
class members, the quality of the reading materials, 
or the design of laboratory experiments. 



The State of the Art . 

A 'thorough review of the evaluative research ^in ^ 
teaching effectiveness Is beyond the scope of this 
planning study. The following review focuses on the 
niajor„ Questions of reliability, validity, and useful- 
ness in student ratings. . ' ^ 

"-Validity, Reliability, Usefulness 
Of Student Ratings ' , 

Rg^n and Rodin (1972), in a frequently quoted 
study, lassert that students "rate most* highly in- 
structors from whom they learn the least." The 
autho rs define the objective criterion as what , 
students learn and the subjective cri£e?lon as how 
the students evaluate the ihstructor. If student - 
rat^li^gs measure the ^f ectiveness of teaching, there 
should be a positive correlation between objective and 
subjective criteria. 
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Rodin and Rodin determined that, \^ith the initl^al- 
ability of the students held constdnt, there was &, 
negative correlation (-.746 p < \05) between what 
students learned as • measured by problem-solving tests 
that exhaust'ed the content of the course and their 
rating of the i^ructors. The authors .argue thaf 
student evaluatidfiW. reflect the personal and social 
qualities of the -tfeacher rather than the instruction. 
"If how much students ^learn is considered to be the 
major component of good teaching, it must be concluded 
-that gold teaching is'^not validly measured by student 
evaluation's in their current form." ^ ^ 

In a critiqu^ of this research. Marsh et al. 
(1975) point out th%t there may- h^ive been methodo- 
logical flaws. In a replication of the Rodin and 
Rodin' study, with methodological problems compensated 
for and a greatly expanded list of variables. Marsh et 
al. found that student evaluations are both valid and 
useful. 

The work of Costin et ai. (1971), FreV et al. 
(1975)^ and McKeachie et al. (1^71) supports (the more 
moderate view of Marsh et al. over that of Rodin and 
Rodin. 

Costin et al.. report that student ratings are 
"reasonably" reliable when correlations from one year 
to the next and from mid- to end-of-semes ter are 
considered. They list a number of criteria that are 
often associated with effective teaching and learning 
by both students and teachers: thorough knowledge of 
the subjecC; preparation for class; motivation of 
students to do their best; presentations of new points 
^ of view or ap'preciations ; and flexibility, enthusiasm, 
warmth, agreeableness , and friendliness^ They 
conclude, however, that although a -review of the 
empirical SJtudies indicates that student ratings 
provide reliable and valid information, these ratings 
"fall far short" of a complete assessment of an 
instructor's teaching contribution." 



Frey et al\ obtained student ratings from large 
multisection courses at three mldwestern univer- 
sities* j Their results demons trate , that student- 
accomplishment, clarity of teacher presentation,* and 
organization or planning of t>he course correlate 
positively with final examination scores and are, 
therefore, valld^ Indicators of effective teaching* In 
analyzing the relationship between student ratings and 
sttident^ characteristics, the authors found that the 
more experienced student^ tend to give higher ratings 
to their Instructors* * ^ 

McKeachle et al • gatherecf and analyzed the 
fact/rs In a, variety of student rating forms* Skill 
of tne teacher, difficulty of the coifrse, structure 'of ' 
the course, feedba^ck to s^dents, 'group Interaction In 
the class, and rapport between students^and teachers 
(warmth) emerged as six stable factors* 

The authors conducted Mve empirical studies. 
Involving more than 1,700 students, to determine the 
relationship between the above factors and effective 
teaching* With the caveat that none of the courses 
w6re Identified as women's studies courses, certain of 
th^lr f landings need to be considered In the assessment 
of teaching effectlvenss In women's studies* 

<fn all five studies, t eachers who were rated 
highly on "structure" tended to be more effective with 
women students than with men students* Teachers who 
were given high ratings on warmth or rapport tended to 
be effective ot> measures of student thinking (applica- 
tion) as opposed to measures of student knowledge 
(accumulation)* ^ And teachers whom students rated as 
having an Impact, on their beliefs were effective In 
changing attitudes* In four of the five studies', 
teachets rated highly on "skill" tended to be par- 
ticularly effective with women students* McKeachle et 
al * recommend that results for men and women be 
analyzed separately: "what works for men does not 
necessarily work for women*" ^ 



Influence of Sex Dlfrerences ' ' . . 

Identification of aex differences in student, 
ratings by ItcKeachie et al • also raises the questioti 
of the influence on student ratings of the. sex of both 
the instructor and the student ^ater. Several studies 
that we have located are concerned witli Che issues of 
sex of the student, sex 'of the teacher, sex 
stereotyping • . * . " 

• - ♦ • 

Perber and Hiiber* (1976)' asked students tp rat,e 
their college teachera in retrosp|^^ct, and found that 
all womeA students evaluated^-- all of^ their teache^ 
^ore favorably than did.lmen students. Harris (1975) 
found, that femare students generally rated their 
♦ teachers' performance higher than did nuaJLe students on. 
descriptions of the style of the teacher. Defining a 
masculine teaching style as active, aggressive, and 
directive and a feminine teaching * style as positive, 
f aciljfcat ive, 'and listening, Harris found' that 
teachSfe who used the masculine mode, irrespective of 
sex, were rated higher in performance than either male 
or. female teachers who used the feminine mode. 

In a subsequent experiment, Harris (1976) soug^^: 
to tfest tHe applicabiiiCy of research indicating* thatr 
men and women^ tend to perceive male-rs tereotyped 
behavior as superior to and healthier than female- 
stereotyped behavior and that American women and men 
both tend to rate tha performance anid competence of 
women lowAr than th^ of^ men^ Harris found that there ^ 
was an "overwhelmin* tendency for a teacher described 
in mascttlinely s tereotypii^d terms to be rated more » 
'positively oh all variables except warmt^h. The 
results of Harris's experiment suggest that feminine 
" traits, ratl\er than female gender, are viewed nega- 

tively in teaching. 

■- • . ■» . 

V Kashak (1978) determined . that disciplined or 
subject areas traditionally associated with one or the 
^ other sex did not affect the ratings of male or female 
professors by students of either sex. The sex ((f t)^ 
professor, however, seemed to be the crucial factor |^ 



which males evaluated faculty members. Women students 
rated female professors equally with male professors 
on such variables as effective-ineffective, concerned- 
uncoticernedV likeable-^not likeable, and excellent- 
poor. They did not i£nd female prbfessoifs less 
powerful and did not discriminate on the basis of sex 
fexcept to 'choose to take a course from a female 
teacher. Male students,, on the other hand, assigned 
^igher ratings to male professors on these variabJ(^s, 
regardless of subject area. These results do not 
support the conclusion of Ifarris (1976) that it is 
stereotyped behavior, rather than sex i-tself, that is 
devalued* * 

Summary 

^ The AAUP (1974) call for multiple measures ft>r 
the assessment of teaching effectiveness has been 
heard throughout the J.and. ^ And Bergquist and Phillips. 
(1975) report that teacher self -evaluation and student 
learning style forms have been developed and are in 
use. Nevertheless, we have not been al^le to locate 
validation studies of these, forms or of /outside 
"expert" opinion. 

Centra (1975) found that, in comparing student 
and instructor peer ratings of the same Instructor, 
stude^nt raters, who have the reputation of being 
lenient (iy.ldebrand , 1972), are less lenientnthan 
facult^i^ peers : the average colleague rating was 4.47 
on a 5-point scaBe; the av€^aga> student/ rating was 
3/^18. Centra concluded that peer ratings are no.t as 
vAlld as s tudent rat ings . ' 

Our position with respect Co the reliability,;, 
validity, and usefulness of student ratings is 
decidedly middle-of-the-road • The bulk of " the 
literature suppo'rts the findings of Marsh ^ al. over 
those o'f^ Rodin and Rodin. It is clear, however, that 
factors such as the sex of the student and the sex of 
the teacher, and the. issue of sexism or sex stereo- 
typing, are potent variables that affect the use and 




usefulness of student ratings. We agree with the AAUP 
that multiple measures should be accepted in the 
evaluation of teaching effectiveness. -However, 
frtudent ratings are better than nofh_ing and are 
going to be around for awhile, and to eliminate them 
entirely because of their shortcomings would be to 
eliminate a large data base ^In and out of ■ women's 
studies. * 
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4. REVIEW OF THE LITERATE ON THE 
* EVALUATION OF TEACHING EFgECT^VEHgSS 
IN WOMEN SI 




This section covers three principal areas: 
(1) overview of the approaches t alee n In ass.'easlng 
teaching ef f ecti^venejss In vomen^s studies > who the 
Investigators are> 'What methods they use, and what use 
Is made of ttielr f£ndlngs; ^(2) chronological review of 
the published and unpublished literature during the 
1972--1978 period; and (3) the published and Informal 
llt;erature of womeh^s studies values » • teaching 
methods » and classrooms* 

Overview of Approaches v * 

At lea^t .three different approaches have been 
used in' assessing vteachlng and/or course 'or program 
effectiveness in women's studies » and a fourth Is In 
the d)^velopmental stage* Although the practitioners 
of anynone method hdve, to varying degrees^ tried to 
Incorporate some of the values^ objectives, and 
methodologies of the other approaches, their work Is 
based on fundamentally different premises* Over** 
lapping values and objectives, and at tli^ies Imprecise 
or conflicting terminologies, tend to blur distinc*- 
tions in^ concept v ^ ' ' 

We cate^gorize the four approaches as: il) 
descriptive reviews of women's studies courses and 
programs^ which provide context for askflng more 
specific questions of teaching ef fjec^MHr^ness ; (2) 
st>udent course Ratings; (3) research of experimental 
design; ' ai\d (4) exploratory or case study research* 

Descriptive Reviews 

In the early phases of course or program develop- 
ment, the descriptive review looks to document the 
need ' and value of women's studies* ' FaCftors such as 
who the students are, the relation between the content 
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of the courses and larger educational 'and societal 
issues » modes of instruction, and outcomes reported by 
students are assessed with an- eye to establishing the 
tjours^ or program as academical ly respectable and 
socially necessary. ' ^ ' 

EsjcampLps of the descriptive review are numerous. 
They, are bfteo contained in program reports and 
requests for course credit or degree-granting status, 
and they are by no means limited to early women's 
studies. Wilson's review of the Women's Studies 
Program at the University oi Puget Sound (^976), 
the final evaluation of "Images of Women in Litera- 
ture"' at the University of Minnesota (Davis et al», 
1975-76), an4^ Howe's Seven Years Later: Women's 
Studies Programs in 1976 (1977) are examples of^hiis 
mbde. d . •* 

The people who do descriptive reviews may or 
rtay not also use the method* of inquiry traditional in 
^./social science research and may or may not t^st the 
extent to which courses and programs m'eet theiif 
objectives. As often as not, ^ practitioners possess 
women's 'studies experience as teachers or adminis- 
trators, or are 'sympathetic to women's studies." 
The descriptive review may contain elements of 
subjectivity. Certainly, to some extent, it must 
rely on impressions. It h«s been invaluable in 
establishing the instiVutional context in which 
women's studies teaching and evaluation occur. 



A variation of the descriptive review — the 
mandated evaluation by outside "experts" — also^ . 
occurs in women's studies. A\comprehensive summary of C 
either voluntary or mandatedNrevtaws is beyond the 
scope of this planning study, and nfany such documents 
are not generally available. The specific examples of 
the voluntary descriptive review tha-t we l^clud^ are 
those available to us that also measure the talative 
achievement of course or program objectives in terms 
of student .course ratings or -experimental design 
reseai^ch . 



22 



ERIC • 3') 



Student Course Ratings 



The second approach — sometimes Included In 
reparts of the f irst—- adheres vlth moire or less 
fidelity to ^he student course rating method of 
Soliciting Information on* a standard ^epartment^al or 
all-unlverslty questionnaire > or on a farm designed by 
an Individual Instructor or a vomen^s studies program* 
Tlie goals of this approach are to produce quantifiable 
data that can be used by decisionmaking groups: 
students » teachers> administrators > and personnel; and 
planning and curriculum committees* 

Contrary to the findings of'Yafiioor et al. (1973), 
that formal course e\raluatlon seemed not to have kept 
up with the growth of women^s studies, 94 percent of 
the respondents to our survey reported that their 
courses were regularly evaluated (sc^^e appendix) • 
Despite the stated reservations about the reliability, 
alJ^dity, and usefulness of student ratings, these 
ratings provide an unanalyzed data base for future 
^research in teaching effectiveness* The research of 
the Women's ^Studies Evaluation Group at the University^ 
of /Washington and ^ the Measurement Services Center at 
the University of Minnesota are^ examples of extensive 
evaluatl^on of course and program ef f ectlveness • 

j 

Experimental Design Research t 

In the experimental design approach, a researcher 
or research team from the outside I— or from some 
point between outride and in — administers tests to 
determine to what extent certatin del^t&ed objectives 
have been aphieved by the ^'treated*^^roup». This 
approach may be used in descriptive reviles (Shueman 
and Sedlacek, 1976) or in case studies that also use 
student coprse evaluations (Davis. et al«, 1975-76), or 
it may be Included in program self-survey reports 
(University of Minnesota, 1978). 
-i 

Sometimes the^ research has hypotheses to prove 
(Borod, 1975) or seeks to validate the cphstruct of 



31 



some particular Instrumerit* oi; scqrlng system (Coffnari, 
1978). tn the most liberal vein, the researcher may 
function a^ a participant observer and/pr check or 
Sttpplement instrument data wi4:h ioterviewa with ♦ 
studetits and teacher's and the hardiest 'folk r- 
with content analysis of student course productiqtis 
(Spelzer, 1975). In studies based on the Multi- 
Attribute Utility Decision~T,^eoretic (MAUT) model, 
participants contribute to setting the goals to be - 
measured (Brush et al., 1978). 

* 

Experimental design studies have, for the most 
part, sought to mea^-ure outcomes in relation to 
assumed or stated course or program objectives, used a 
pre- and post-test format (with or without a control 
group), gathered , basic' demographic information, and ^ 
, concentrated on measuring^ self-cona|fept , sex stereo- 
typing, and sex-role ^attitudes. **>Exceptions to an4 
variation in this pattern will be noted • 

» It appears that e^^perimental de^gn studies 
either posit a connection betw^n affective changes 
and the enhanced ability to absorb and utilize subject 
matter, or assume that affective change l8_ one of the 
goals of t/he women's* stud ieis course* The use to which 
th'ese studies are^ put is not always clear in^, the 
Itt^ratur^* Sometimes, the proposed course of action 
* is to improve the design' or scope of future studies* 
Sometimes, it is In the application of the results 
to specific issues, in developing women's studies 
^ curriculum* 

E)tplorat6ry or Case Study Research 

Yhe exploratory- or cttae study approach differs 
from many«^of the experimental design research methods 
by more directly addressing tMe issues 6f materials, 
methodolbgies , structures, and pedagogies used in 
women's studies /-classrooms. Bonnepatth (1978) 
describes the concept behind the development of this - 
approach as follows: 
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A commitment to Innovatioa in curricula 
f and teaching technique musjt be carried over 
to the evaluation process itself • Surveys 
5JLudfint „ cha r act e riatlxia and. axti t udea; 
• provide important feedback on many ques- 
tions» but alternative evaluation tech- 
• niques are needed get at the theoretical 
issues* * 

Some of the theor/etica^ issues raised* by Bonne- 
parth that are addressed in the literature on the 
exploratory or case study research include:r the 
rationale belfind establishing o^e kind of women's 
studies course or program rather than another ; ques- 
tions of content, focus » and progression; the relation 
b^ween learning aa<f doing; and the process of miaking 
/goals operational. Again, it should be noted that 
there may be overlapping objectives between this' 
aptproach and the others. 

The research conducted by Talburtt et al* (1977), 
based^ on ,the formative evaluation model, focused on 
the effects of three types of women's edfucation^iJL 
programs (Internships, ^.women'^. studies courses, and 
skills development classes) in eight institutions. 
The exploratory research of Elovson and Cockcroft 
(1977) concentrated on assessing the inq^att' of women's 
studies courses on students' lives. The case studies 
of Davfs et al. (1975-76), Kritek and Glass (1978), 
and Register et al. (1978) assessed the currlcular, 
methodological , { s true tural , pedagogical , and outcome 
aspects/ of, rebpectively , an "linages of Women in 

^Literature" couipse, a coujrse oriented toward probleim 
solving and the interrelations'^ between professional 
nursing .and the women's movem^ent , ^nd a two-term 
senior Integrattve^^seminar «for women's studies maJoi;a. 
Mthougn specific applications 9f the fourth approach 
may vary in ^de&lgn and scope, they share an emph^^si^ 

'on the direct utilization of findings by students, 

teachers, and program planners. ^ 

i 
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Review of the Literature 

For the ^purposes of this planning study, we have 
chosen fee ^gantae th» matarXala- lo— this - stibae c tioa 
chronologically. A straight topical or thematic 
organization would have the a4vantage of identifying, 
major issues and methodologies and of addressing 
discrete aspects of, the subject of teaching effective- 
nesj^. However, the presence of overlapping objectives 
and methodologies in the literature, compounded by 
confusions vin terminology- and varying decrees of 
methodological specificity and consistency, make 
thematic or topical organization difficult from d 
conceptual point of view. ** , 

A chronological organization has the advantage of 
documenting changes in the focus of women's studies 
evaluative research, particularly wheft we consider the 
time frame in which a specific study was undertaken as 
opposed to the date of publication (or, in the case of 
doctoral research, the year the degree was awarded). 

Women's studies is a field in the process of 
evolution. This fact is reflected nowhere more 
clearly than in the literature on its evaluation. Our 
review of this literature cannot be complete given 
that many studies that undoubtedly exist have not been 
reported or Sisted in the conventional indices. Our 
review is as complete as it is* thanks to t;he help, we 
received from individual woman's studies instructors 
and programs. " - , * 

" ChroftoloRical Review of 1972-75 Studies 

« 

By surveying 125 instructors listed in tl>e 1970 
Modefn Language Association Current Guide to Female 
Studies , Yamoor et al. (1973) found that, of the AA 
percent who responded, ^nly 16 percent reported that 
their courses wpre formally evaluated. • The team 
concluded that, "feedback indicate^ a highly favorable 
reaction, from students, but instructors^ lacked the 
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time ^nd research competence . to conduct evalu€^tlon 
yielding objective data." 



Yamoor^et aj.. assessed the outcomes of "Life 
Styles of Educatjed' Women" a-t the University of 
Minnesota^ using a questionnaire they designed (the 
Minnesota Women's Scale, 1973). The team did not seek 
to measure changes in attitude, and they had no 
control group. Therefore, it Iq difficult. to know in 
what ways the vomep'-s studies students in the course 
differed from other students or," with the exception of 
the positive course ratings, whether the "favorable" 
outcomes reported were the result of having taken the 
course. 

Impact of 1973 Wesleyan Conferences . In lj973, 
two conferences were held at Wesleyan University 
(Connecticut) ,to discussi the conceptual and ethical 
Issues involved in evaluative research, in women's 
studies and the relative merits of several evaluation 
models. As reported by Tobias et al. (1973), ioipng 
the issues discussed at the. first conference was the 
subject and * control of any evaluative research. 
Also addressed was the appropriate mechanism for 
measuring the attainment of goals^ that range f rom^. 
affecting individual values (increasing self-esteem 
an3 intellectual competence) and group values (posi- 
tive attitudes toward yomen and^ the ability to work 
cooperatively ), through challenging myths about women 
and generating new theoretical models within the 
varid^s disciplines, to Instigating institutional and 
societal change. The ccnrfference was inq>ortant for its 
attempt to define Values and j^oals for women's studies 
and women's studies evaluative research on a national 
level. / 

- \ ^ • 

As. a direct result of the two conferences, 
several evaluative studies were undeiftaken using 
variations on the MAUT model introduced bV the late 
Marcia Guttent^g. Although* Guttentag's model was in 
its developmental stage when presented to the Wesleyan 
c(#hf erences, it is important to ' understand why it 



was attractive to the participants, as well aa the 
rationale behind its specific applications* 



^.j^g,^^ ^^^^ given to the" 

kind of evaluative reseaxfch that would produce 
information of direct use to, women's stujiies teachers 
and st'udents in improving courses and programs* 
As reported by Tobias et al., J!AUX offered the oppor- 
tunity for, course or program parficipauts to develop a 
range of goals to be achieved, to rank the goals in 
order of prior^ity and probability of achievement, and 
to use existing instruments of measiiring change or to 
"design new measures to answer questions of specific 
concern to women's studies teaching and evaluation* 
In sum, "the decision-theoretic model offered the 
chance of stating both- short- and long-range goals and 
the possibility for ' women's studies practitioners to 
control the process and direction of evaluation* (A 
more detalLed ^ discussion of this model is presented 
in the following subsection.) 

One evalua|ion of a women's studies program that 
came out of the Wesleyan conference^ was conducted by 
Mangione and Wiersma (1974) at the University of 
Massachusetts/Boston. Their research was intended 
both as a descriptive review of tJae program's educa- 
tional value and as^a^ planning study for future 
development. Students, faculty, and staff were 
involved in setting the objectives to be measured, 
based pn the values discussed ,at the Wesleyan con- 
ferences, suRplemented by goals that might be specific 
to an urban workirtg-^student population. The objec- 
tives were measured using an interview questionnaire 
that sought to determine the extent to which the 
•expectations of a variety of students (men, women, and 
minorities) were being met by the women's studies 
cours^ ^n the program. - 

Mangione and Wiersma established that, on the 
whole, student expectations were being met. The 
researchers noted synergetic effect from taking more 
than one course; that is, the more courses tak^n, the 




greater the achieyement of goals* Significantly, when 
asked to rate women's studies courses with respect to 
their other college courses, 45 percent of the study 
participants considered tlieffi "better" or "inuctF 
better*" Women rated thfe courses higher than did men, 
and women's studies "concentrators" rated the courses, 
the highest of all* # 

Although Mangione and Wiersma made specific 
recommendations for addressing the needs of men and 
minorities, for the purposes of this review, the 
remarks of Ferguson in the introduction of Mangione 
and Wiersma's report are mpre relevant* According to 
Ferguson ^'''^Vattitude changes" were not assessed because 
there was iio scale sensitive enough to address ^ the 
issue of consciousness raising in arn environment 
having multip'le influe'hces* Moreover, *one of the 
most important findings of the study was "the value 
students give to cognidiive; learning in Women's 
Studies*" Being prese.nted with "solid information" 
and learning techniques for .acquiring knowledge and 
for "assessing their own experiences were more^ 
important than attitudinal changes*" Presumably, this 
appreciation for cognitive learning was expressed 'in 
the student interviews* 

It is noteworthy that, although the a^cquisition 
of knowledge and "int§jll^ctual compejbence" were aWong- 
the va-Jfues describ^ at the Wesleyan conferences 
(Tobias et al*, 1973), the majority of the expetfi-^ 
met^t-al studies have sought to measure changes in 
attitude, -using one or more of the Instruments devel-^ 

'Oped in the early 1970's to measure /the acquisition of 
new attitudes as the result of the rise of Ijiterest in 
feminism and the women's liberati^iv movements S*ch 

^instruments Include the Spence and Helmreich Attitude 
Toward Wdmen 'Scale CAWS, 1972), the Bem Sex-Role. 
Inventory (1974) , and the revised Minnesota Women's 
Scale (1974)* Oldet instruments, such as the Ten- 
nessee Self -Concept Scale (1965) and the Brovermah 
Sex -Role Stjereotype Scale (1968), will be noted in 
place* As Ferguson suggests, some o^^^ the questions 



that surround wh<in and what to measure In women's 
studies Involve the appropriateness of these scales In 
an evolving field. * 

Focus on Sex-4ole Attltudbs . Buble et al. (1975) 
conducted two field studies at the University of 
California t Los Angeles in which they tested the 
extent to %»iich three women's studies courses > were 
effective in changing sei^role attitudes^ of partici- 
pants in relation to a control group. Five general , 
areas were analyzed: future plans; dislike and 
distrust of women; agreement with traditional roles of 
women; - nonstereotyplc beliefs "about) sex roles; and 
perception of sex discrimination. Tne* authors found 
that women's^ studies ^ classes significantly increase 
students' nonstereotyplc beliefs and their * perception 
of sex discrimination, while dec1:easing their .agree- 
ment with the traditional role of women, even in a 
one-term course. However, -the research found no 
significant change i'n career pl^s or with regard to 
dislike and distrust^ of women! The 'authors also 
found that> women who inftially ^ had more traditional 
attitudes changed the most. Their research could not 
determine which aspect^ of the courses accounted for 
the specific outcomes. ^ 

In. an unpublished dectoral dissertation, Spelzer 
(Boston UnivetiBity, 1975) reports on her use of the 
Attitude' Toward Women Scale. This 55-item test of 
profeminist (defined as "liberal")^ attitudes toward 
women was used to measure changes in feminist orients-* 
tion among studeotts who participated in a, one-semester 
course entitled "Perspi^ct ive on Women in American 
Society" at Garland Junior College (Massachu^tts) in* 
1974. Spelzer /found that the scores of the students 
in that course |) rase significantly in comparison with 
the scores of Chem other women enrolled in the college 
that semester who were tested. This reflected, 
Spelzer concluded i a heightened awarenesfi of sex-role 
stereotyping; attitudes toward women as a direct result 
of the cours§. * ^. 
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Using Rosencrantz's V theory of self-concept 
(1968), Spelzer hypothesized that a negative" self-' 
concept would change as the, result of exploring 
sex—role stereotyping in* a w^men^s studies course* 
The verbal and written statements of the students, as 
reflected in class discussions and in journals , were 
analyzed for Miits and themes that would express 
positive or negative femiqljnre self-concepl:, positive 
male 'self -concept , or no self -concept • Speizer^s 
hypothesis could neither be coafirmed nor refuted* 
She discovered tliat, although the §.tudents were' 
willing to talk about women in general, they were 
reluctant to talk or write about themselves* 

• Spelzer also concluded that different teaching 
styles did not affect outcomes ih the two wopieri^s 
studies cou];ses studied* She comments on the extent 
to which her findings can be generalized, and, for the- 
p^urposes of this review, miakes a telling point about 
the AWS: 

Attitudes toward women and men's roles in 
our society seem to be changing very fast* 
It is difficult, therefore, to ^flnd an 
instrument which is valid and reliable even 
within a year of ^±ta publication* 

Value of Sharing Common Experiences * Bo rod (Case 
Western Reserve* University, 1975) hypothesized, 
that female participants in her "Psychology of 
Women and the Acquisition of Sex Differences" course 
would decrease the discrepancy between their per- 
ceptions of typical masculine and^ feminine charac- 
teristics, become less stereo typicfilly feminine in 
their real and ideal self-perceptions, and become more 
liberal. in attitudes toward women's rights proles, \nd 
privileges* Using the revised Brovermfll Sfex-Ito'le 
Stereotyping Questionnaire (1972), the AWS, and the 
Women^s Liberation Movement Questionnarie, ^orod 
Qonducted pre- and » post-course, testing with followup 
measurement 3-1/2 months later on both the experi- 
m,ental and - ccfrttrol ^gtoups ^ Da t^, analysis did not 



support any of her hypotheses* Surprisingly, however, 
the women who formed the control group became signifi- 
ca'ntly more profeminist in their attitudes toward 
women and less stereotypic In their perceptions of 
real, self and of the differences between males and 
females, but only over the period of the study* 

Borodf undoubtedly dispirited by her findings^ 
explained them variously* It was possible, she 
suggests , that the women's studies course might 
"reinforce, rather than liberalize, sex^role stereo- 
typevs," particularly since the course readings and 
lectures emphasized "researched descriptions of sex 
differences, and their acquisition." This is an 
important analysis because it is quite possible that 
courses in which the materials run counte^r^o the 
objectives may present special problems in teaching 
technique (see Hoffman, 1S72)* ^ 

A major implication of her findings, Borod notes, 
is that, ±f^ the goal of women's studies is to change 
sex roles, then instructional formats that encourage 
sharing common experiences, as in a consciousness- 
Tailing group, might be more effect^ive. Borod also 
suggests that exposure to the milieu created by the 
women's movement and participation in the study itself 
may have influenced the scores of the control group* 

Further Study of Attitude Changes * Shuemah and 
Sedlacek (1976) in 1975 conducted a study that com- 
bined the legitimizing aspects of the descriptive 
review with experimental research on attitude changes* 
The authors compared students in nine women'^ studies 
courses with students in an undergraduate psychology 
course at the University of Maryland* In addition to 
gathering demographic information, data on attitudes 
relating to career goals and women's issues, and 
course evaluations of teaching effectiveness, they 
used the Bem Se?c-Role Inventory (1974) as a measure of 
psychological androgyny, and the Tennessee Self -Concept 
Scale (1965) to assess chaivges in feminine stereo-* 
typing and self -concept as the result of the courses* 




The researchers made an effort to align the concepts 
th^y wlsl\ed td measure with Information on the objec- 
tives of the women's studies prograiii outlined in 
T^S~9 — 

The author^ reported that, in 1975, women's 
studies courses were largely af interest to women, 
were taught mainly by women, were offered in tljB 
humanities and social sciences, were perceived by the 
studejnts as academi<fally rigorous, and did increase, 
student awareness of sex roles and the "situation" of 
women in society. They foufid, -however, no significant 
change in self-concept or stereotyping that could be 
attributed to the courses, and speculated th&t . dne 
semester may be "too short a time for any significant 
change to occur and be reflected in a standardized 
measure*" 

Scott -et—et# (1977), reporting on research they 

conducted in 1974, found ^ that some student .attitudes 
can be-altered by a one-semester or one-quarter coursj^ 
in women's studies as measured on tlie AWS« Their- 
"feubjects were students in two midwestern /colleges.^ 
The authoirs suggest that the influential factors « 

^In liberalizing scores were the relevance of the 
materials in the course tnt sl predominantly female 
enrollment, emphasis student involvement in 

discussions, and the usey^f strong historical women as 
role models, as well' as the contemporary role models 
presented b;^ highly competent guest speakers. , 

In an evaluation of a course entitled "Achieve- - 
mefit Motivation in Women r Psychological and Socio- 
logical Perspectives" (1975) at the University of 
Minnesota, pre-* and ppst^course assessment on four 
scales (Serf -Assessment Scales, Attitudes ^Toward 
Women as Managers, AWS, and Achievement 'Motivation 
Inventory) did not^ detect any changes that could, be 
attributed to participation in the course. . In student 
self-evaluations, however, ma:tiy reported that they4iad 
not only" learned new facts, theor!Us, :and approached. 



but had ^Iso gained new perspectives on themselves as 
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women and as scholars and were, much more<^ ready 
assume responsibility for their educations • 

J? 

^ ThangB* <^Jnive«rity ^ Gelif^miaj Les Afeg^les, 
1975) reported In an unpublished doctoral disef^rtatlon 
that the students who scored the highest *ln feminism 
on the AWS were those enrolled In women's studies 
courses In which the Instructor announced either 
verbally or through course objectives that she was a 
feminist* In courses in which the Inst^ructor was 
explicitly or impl^lcltly "critical" of women, the 
scores on the scale were significantly lower. Thames 
called for the development of a questionnaire that 
would tap the most feminist and radical interests and 
attitudes of students in order to measure the full 
spectrum of responses to woman's studies* 

■ * 

The MAUT Model 

Although GuttenAg's Multi-Attribute Utility 
Decision-Theoretic model did not reach a national 
women^'s studies readership until 1978, versions of 
MAUT wjBre published as early as 1973* And Guttentag's 
presentation at the 1973 Wesleyan conferences inspired 
several studies .based on her methodology, including 
that conducted i>y Brush et al* during 1974-75 at 
Wesleyan University* The results of par^ of that 
study were circulated as early as 1974,^ and a flqal 
version, "The Paradox of Intention and Effectis A 
Women's Studies Course," received wider distribution 
in Signs (summer 1978)* 

Report of Guttentag et al* In "Evaluating 
Women's Studies: A Decision-Theoretic Approach" 
(Guttentag et al* , 1978), the authors characterize 
some of the problems that traflitional research 
encountei^s when addressing itself to women's studies* 
First, formal evaluation, usually conducted by an 
outside evaluator, may not ae^k the kinds of questions 
that most women's studies practitioners want answered* 
These questions deal less with success and more with 
ways in which courses and programs <:an be improved* 



Second 9 the- traditional models of evaluation often 
measure goals that are not shared Is^ the various 
groups that have an interest' ipi the project* Third, 
goals and expectations may change during the period 
of evaluation^ The traditional models, which are 
oriented toward summative results, may not be able to 
accommodate the revision. ) 

MAUT involves the participants of the evaluation 
directly in setting goals an<j[ in ^^^ablishing priori- 
ties that are specific to a particu»r course (or to a 
number of coursos in a women's studies program) , as 
well as in assessing the probability of achievement • 
The eValuators are responsible for finding ot devel- 
op ing-x techniques to mfeasure the degree to which any 
given goal is igft, and for collecting and analyzing 
the data using Bayesian statistics. The opportunity 
for different groups to establish different goals for 
the evaluation and to assess the pro^bability of 
achievement seems particularly important in a field in 
whiQh t^e goals range from increase^ iny^llectual 
self-confidence to changing society. 

An important part of the process involves identi- 
fying'^ the areas to be evaluated and making thQ defini- 
tions Operational; that is, breaking the expected 
outcomes Sown to specific attitudes or actions and 
identifying the alternative instructional formats for 
implementing the jgoals. 

, The MAUT modi^l, the authors argue, permits 
the kind of "iteration!* and flexibility needed in 
evaluating the complex expectations of women's studies 
courses and programs. Their presentation does not 
specify instruments that are compatible with MAUT; 
they^ do say that priority Should be given to devel*-' 
oping new and appropriate techniquejs for measurement* 
Analyzing the data collected at any point in the 
process, assigning "^^portanc^ weights," and convert- 
ing these weights mathematically by Bayesian dtatis-* 
tical analysis permits a series of interactions 
between probability and testing restilts so that a 
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judgment may be made about which sort of Instructional 
mode or course best achieves the desired goal* 

^ Repo r t of fr r uah et el* - — ^rush et-^t* begin their 

report of a specific application of MAUT with a 
statement that needs to be viewed in th/^context of 
the evolution of women's studies* Of the^, two . sets of 
goals that are emphasized by practitioners "the 
traditional academic goals of intellectual mastery of 
subject matter and the imparting of a substantial 
amount of information" and the "less traditional goals 
of personal change" the researchers considered ^t 
more worthwhile to test whether the second set of 
goals, "resocializatlon," might be achieved in a 
classroom setting during a one-semester interdis- 
ciplinary course* The goals of resocialization, as 
specified by the participants, were categorized by the 
researchers as improved self-esteem,^ improved self- 
concept, and commitment to a "feminist ideology," 
defined as changed attitudes toward the social role of 
women,- raised careet aspirations, and consciousness of 
sex bias* < 
» 

The instruments used included the Bem Sex-Role 
Inventory, the Broverman Sex-Role Stereotype Scale, 
the I Am test (Kuhn and McPartland, 1954), and a 
revised version ^f the Minnesota Women's Scale, 
supplemented by questions to elicit information on 
career plans and reactions to sex bias that was 
used to "graph ideology*" When the results of the 
Minnesota questionnaire were discussed a year later 
with the students, ^Jppontaneously nientioned changes" 
attributed to the women's studies course were recorded 
and analyzed*' * 

As suggested by the title of the Brush et al* 
report, the ..authors found a paradox of intention and 
/effect on several levels* The first paradox involved 
the stiidents and the cqurse goals* Consistent with 
the findings of Speizer (1975) and Ruble et al* 
(1975), entry level scores of the women's studies 
enrollees Initially were high* In the Brush et al* 



|tUdy» the scores of some of* their control groups were 
also high* (The* number of men In the study was small^ 
and their scores were not tabulated •) 

Brush et al* found that women who came into the 
course with more traditioriaJ^ attitudes changed the 
most* Fors^ the rest, the course tended to validate ^r^ 
clarify prior beliefs and to reinforce their retention 
by providing information, forms of argumentation, and 
the opportunity to articulate belief, information, and 
critical analysis • In at least one of the authors' 
control groups, initially strong prbfeminist beliefs 
weakened over time, presumably because they had not 
received the kind of reinforcement and strengthening 
that a' women's studies course can provide. 

The second paradok involved tKfe measurement 
in^truiSBnts. For all the authors' effort to ch<iose 
sophisticated instruments, the statistical measures 
failed to detect the kinds of changes that ^tlie 
students reported in their l^erviews a y^ai; or more 
after the completion of the ^CTurse. Content analysis 
of interview data suggested Some changes in 9elf-i- 
concept, and particularly in the areas of heightened 
self-confidence, in the value placed on independence,, 
in the acceptance of qualities of masculinity and 
feminity about which some of the^wometi's studies 
students initially had been ambivalent, and, on the 
part of 6 of the 16 women interviewed from the 1974. 
classes, in« an increased respect for women.* 

Of the various .conclusions the authors drew, 
perhaps the mbstt relevanf^for this part of the litera- 
ture review is their assessment of the changing go^s 
of this particular women's . studies course since its 
inception in 1970. Initially, changes in behavior and 
attitude — the second set of goals were of primary 
concern. By 1978, however, when the study was pub- 
lished, both the instructpr and the students stressed 
"intellectual mastery" as their primary objective in 
giving or taking the course* The instructional format 
had also undergone unspei^ffied changes. 

■ ' ■ -3 
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Chronological Review of i975"78 Studies 

Interviews conducted in 1975 by Bose et al. 
XlSilty vninftn^B g tudias maj ors and nonmaj grs at „the 



University of Washington support the findings of Bru^h 
et al. — i.e., th«t students report positive changes 
in self-image aSia result of their women's studies 
iBxperienceg. Jhe students in the Bose et al. sample* 
also* reported "an increased awareness of their own 
needs, and more faith ijx their ability to fulfill 
these needs," thus confirming the value (or perhaps 
the necessity) of independence. 

Effects of Introductary Sequence . study of the. 
effects of the introductory sequence, at the University 
of Minnesota (1976) used the Washington iFniverdity' 
Sentence Completion Test of Ego Development (1970) and 
the AWS. No pre-' to podt-^course changes in ego levels 
or attitudes were found either in the control groups 
or among the students who had conq)leted the women ^s 
^studies introductory sequence. The research estab- 
lished, however,' a correlation between the women in 
both groups who had more liberal attitudes toward 
women and a higher than average ego level. The report 
suggests that this correlation may stem from the 
ideals o£ self-realization and identity supported by 
the women's movement. 

Coffman (1978) reported on her 1976 investigation 
of the effect of Inttoductoty V6men's studies classes ^ 
on sex-role stereotyping. Coffroan hypothesized that 
these classes would reduce sex-role stereotyping by 
increasing androgyny and masculinity scores on the Bem 
Sex-Role inventory and that the control group of 
introductory sociology students whd expressed dn 
interest in taking women's •stu4ies courses would not. 
Coffman also sought construct validity for psycho- 
logical androgyny which was defined operationally 
Sis the ability to respond flexibly to situations, 
as opposed to reacting according" to sex-role prescrip- 
tion. She anticipated, increased masculinity scores as^ 
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a prellaJlaary a tap to f androc^ny baaed on the findings 

of Stelger (1977) and lothers. 

i 

Cof iaan'^ 4atanlanaiya4a d4d aot^a^ipixort h^x~ 

hypotheaas with reapej'ct to the women^s studies Intro- 
ductory classes: nejLther these nor the Introductory 

'sociology courses ilgi^lflcantly reduced sex-role 
stereo typing > %ihlch was a goal 'of the women studies 
course at the University of Washington. 

Two^ other studjles conducted during this period 
were exploratory lln design and relied ^heavily to 
fxcluslvely on student seif-i^port* These 8tudl,es 
addressed » respedtlvely > program effectiveness 
(Talburtt et al*» 1|'977) and Intact of ^omen's studies 
tourses on studentis^ lives (Elovson and Cockcroft» 
1977) • Both studies Illuminate some of the cognitive 
and pedagogical Issues 'tl:tat are revealed In the threfe 
case studies dlscui^sed later In this section* 

Study of Program Effectiveness > The goal of 
Project WELD (Women^s l^ducatlon: Learning ana Doing) 
was to evaluate tq^ Impacts outcomes » and lnq)llcatlons 
or three women^s f educational programs: .Internships » 
defined as career exposure In out-bf ^-classroom 
settings; womenfs studies academic courses (not 
necessarily a part of a ' formal women^s studies 
program); and skills development classes or workshops^ 
Including assert iveness trainings career planning » and 
personal gro^h experlen^s* The programs were houaedf 
In eight ln8B[||utlons» six of which re primarily 
women^s colle^R and two of which were coeducational 
universities wlch women^s centers* It should be noted 
that although tne programs were viewed separately, any 
combination of /the three may be lacluded In a women^a 
studies 'program. ' . ( 

Using a pre-tested form, Talburtt et al. Inter- 
viewed students (most of whom had completed the 
programs a year prior to the Interview) , teachers, 
administrators, and supervisors, and they consulted 
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with a national advisory board. The interviews 
provided both quantitative and qualitative informa- 
tion, and primacy was given to returning the rejsults 
to the^ lost.! tut Ions to document and/or to_ improve 
their programs' effects. 

. Talburtt et al. found th'lat, for the most part, 
the students chose the various programs to gain the 
general outcomes promised, that the outcomes were 
achieved , and that unexpected results were achieved 
that were highly valued by the students. Internships 
promoted pro^^essional skills and career exposures, but 
they also increased self -conf idence and sense of 
personal potential. Skills classes were reported, as 
developing interpersonal skills/ They also developed 
self-confidence, independence, feminist perspectives, 
and self -understanding. In other words, each type^ of 
program accomplished its objectives and fostered 
outcomes that were unanticipated. When the students 
compared their programs to their ' other classes, in no 
case did they report that the "traditional curriculum" 
developed qualities that they considered important irt 
a significantly better way. 

^ • . > 

As the authors note, program structure has impact 
on educational outcomes, for the outcomes were indeed 
different, even with some overlappings . 

Women's studies would appear to be the most 
direct route to* fostering feminist con- 
sciousness about women's past and present. 
Axk internship encourages the development 
of prof ess ional potential and antidis-^ 
crimination skills better than either [oFj 
the other two program types or the tradi- • 
.t ional curriculum. Yet with the exception 
Jof a s ense of women' s histrorical pas t 
/and professioAal qualities^, Xhe skills 
^ej^perience seems to promote every other 
attribute better than the traditional 
college experience, 
f 
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Internships an^ skills classes may already be a 
part of a women*s studies- program (as they are at 
Portland State University, for Instance) or ma;^ be a 
part of a women^s studies course that dlff era~f rom the 
ones In Talburtt's study* Nevertheless, the findings 
of this research have Implications for building 
curriculum In and out of women's studies, particularly 

c±n an era In which students are acutely sensitive to 
the relation 'between their education and future 

.em|>loyment (Bose et al# , 1977) • ^ 

While a majority of the women's studies students 
found the course Impact to be greater than other 
educational experiences, 23 percent of this group 
rated their classes as having the "same" or "less" 
Impact, a higher percentage than in either the skills 
or the internship groups* Satisfaction with the 
"academic content" was slightly higher in women's 
studies than in the other two programs* The authors 
propose that, in this study, the copoparabllity between 
women's studies and traditional courses made It easier 
for the students to know what to expect by way of 
cogijltive development and hence were better able to 
measure the cognitive development gained^ This study ' 
also foun^ that teacheris slightly overestimated the 
possible outcomes of the women's studies courses, 
particularly, in the areas of creativity and leader- 
ship* * 

Impact on Student's Lives * The exploratory 
research of Elovson and Cockcroft (1977) was designed 
to generate a bro'ad base of data to illuniinate 
currlcular and pedagogical Issues and to develop a 
"reliable and sensitive" Instrument of assessment* In 
examining the impact of participation in'^women's 
St udles c lasses on students ' lives over time, t he 
authors proposed an alternative to the "def^ned- 
objective" approach to evaluation* To avoid the 
methodological difficulties, the "paradox of Intention 
and effect," and the unanticipated outcomes that 
so often, crop up in the literature, the authors 




recommended the "empirical-inductive" approach and the 
^xpandted use of student self-rjeporting. 



Using a comblnattx^n of open-ended and directed-- 
attention qijestions, Elovson and Cockcroft gathered 
"impact" ddta ,from some 200 women's studies students. 
Ninety-three percent of the students reported * impact • 
When individual impact scores were correlated with the 
number of women's studies courses taken, it was found 
that the more courses taken, the greater the number of 
scores of support and reinforcement for previously 
held ideas, feelings, and behaviors, tljus arguing for 
the internalization of in5)act in the students' lives. 

Ninety-five percent of the studehts responded 
that they had encountered new material in their 
women's studies courses. Moreover, 19 percent 
reported that the new information affected how they 
viewed issues outside women's studies. The students 
also reported that the female teachers -had served as 
role models in competence, energy, intelligence, 
achievement, and commitment to scholarship, as well as 
irT^personal warmth ajad-^pression. 




Three Case Studies 

The case study approach to evaluative research in 
women's studies is pethaps the most widely represented 
In the informal literature. - The examples presented* 
here combine traditional course ratings with an 
emphasis on instructor monitoring and ana/lysis of 
course progress, leading to changes in pedagogical 
approach, content, and class structure. These studies 
differ in the degree to which they also contain 
aspects of experimental design and descriptive review. 
They are joined, however, by the degree of attention 
given to the content, structure, and teachirig strate- 
gies that make operational course goals. 

Research of Davis et al. The research of Davis 
et al! (1975-76) encompassed evaluating the 'success^ 
of the "Images of Women in Literature" course 



achieving Instructional goals » measuring changes on 
the AWS^ comparing demographic characteristics Vlth a 
control groups gathering feedback or\ instructional 
effort during the term, and documenting the suit- 
ability of the course as a permanent offering. 

The authors found that the objectives of'-the 
course were met; The students gained a greater 
knowledge and appreciation of women. Post-course 
scores on the AWS showed significant improvement as 
the result of. Instructional effort, while the scores 
in the control group did not inqprove. 

Research of Krltek and Glass . Kr i t ek and Gl as s 
(r978) evaluated a course of fered in a professional 
nursing program and cross -lis ted with the wdrmen^ s 
studies program at the University of Wisconsin/ 
Milwaukee, thus drawing students from each. The 
course was oriented toward the interrelations between 
nursing as a profession and the women's movement, and 
it emphasized creative problem-st>lving. 

The authors found that the examinations and 
projects assigned encouraged originality, initiative, 
and self -dlrec tion, and fostered a feminist per- 
spective in nursing. Students reported that class 
discussions had led to on-the-job asserfelveness with 
respect to the sexist discrimination they perceived* 

Krltek and Glass^used the Allport Study of 
Values, an evaluation Measure of their own design, and 
student ratings of materials and Instructors. All 
measures showed significant progress toward obtaining 
cbt^rse objectives. ^ 

Research of Register et al. Register e4: al . 
(1978) describe at length the design, progress, and 
evaluation of a two-term senior integrative seminar at 
the University of Minnesota. The purpose of the 
research was to determine how best to meet a women's 
studies program requirement that maj ors have the 
opportunity "to direct knowledge and methodologies 
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gained from other courses and experience's toward 
topi-cs of an interdisciplinary nature with a focus on 
wpmen^" ^ 

During tTie f if sC Eefm of ttre course^, the four- 
instructors worked as a cooperative team, alternating 
in presenting lectures on the following topics: 
assumptions that characterize scientific research 
and analysis of the process by which theories are 
constructed; anthropological approaches, including 
cross-cultural comparisons ; literary criticism; 
Jungian psychology; Marxist and Marxist-feminist 
methodology; and biases and problems in the behavioral 
and social sciences. -The lectures and subsequent 
discussions were inteiyied as overviews and preparation 
for the second term's requirement that students 
develop '^their own research topics on the theme qf 
women, culture; and power. 

The second term was structured to give studtents 
the opportunity to work on their research and to meet 
once a week for studentj-led discussions of a work of 
feminist theory. The final 2 weeks were devoted to 
the oral presentations of student projects before 
these were submitted in written form. 

A summary. of the evaluation cannot do juptice to 
the complexity of the task or the results. At the end 
of both terms, students were asked to evaluate such 
matters aa« the difficulty of the reading and its 
appropriateness both to an interdisciplinary approach 
and to their own feminist concerns; the success pf the 
teachers in presenting^ subject matter and as human 
beings in the classroom; and their own and other's 
participation in the seminar. 

Register et al. began their discussion of the 
results by sayfng that the /'process of self and mutual 
evaluation^ has not always been pleasant, but we feel 
that it is a vital part of the growth of women's 
studies./ • Stude'nts and teachers had entered the 
course with a high level of expectation of themselves 
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and one another* The conflict between the academic 
eiaphasls of the teachers and the actlon-orlentatlon 
of some of the students, a^ well as the teachers' own 
struggles to integrate academie values and feminist, 
action, permeated the course* Students and teachers 
had tried to clarify 'their own understandings of such 
terms as "feminist" and "interdisciplinary," but the 
diversity' of the perspectives resulted in shifts of 
focus: the center did not always hold* 

The instructors were surprised at the levels of 
difficulty thei students Reported in the readings* 
They wete equally surprised that what they had per- 
ceived as an experiment in cooperative feminist 
^teaching was viewed by a number of the students as 
a class top-heavy wit\i^ instructors who formed a 
silencing block of authority* T^*^ instructors' 
assumption that mutual trust and respect had been 
developed before the beginning of the course proved to 
be unfounded* . 

The instructors /also di3covered the "real risks 
involved in attempts/ to integrate the academic, the 
political, and the/ personal and to be teachers, 
allies, and friend/s." Some of the critlcTslms^ tTie 
students had of the/ course — the abstractness of the 
overviews, the relative lack of student input into 
the design and progression cf the |^irse — became 
personally directed^ toward, awne of ^Be instructors* 
Ironically, the encouragement to mal^ a radical 
critique of education often f i|^ds the encouragers ' on 
the receiving end of the stick* Yet for all the 
si lences , disappo intments , and crosscurrents o£ 
feeling, the students on the whole rated the course, 
the teachers, and their own learning positively* 

The findings of this evaluation led to modifica- 
tions in the course Requirement , particularly in the 
direction of a realistic reassessment of what an 
integrative course promises and what it can actually 
deliver, and in the development of options for meeting 
the requirement* — - 
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SuiMnarv of Findings 



This review of the literature Indicates that the. 
8tandarll««i »>»a«wr«s used to gauge the effectiveness 
of women's studies teaching have not proved to be 
sensitive to the changes, in perception and attitudes 
that are reported In student Interviews And In the 
exploratory and, cfise study research. , The exception to 
this Is the Attitude Toward Women Scale, the*^ workhorse 
of experimental design rese'arch. 

» '■ ■» ' 

rn the studies that reported using the AWS, four 
founcf pre- to post-course "liberalization" of score? 
liitaong women's studies students and three did not. The 
^estlonnalre used by Ruble et al. (1975) detected 
statistically significant changes in attitude toward 
the traditional role of women, a reduction in stereo- 
typic beliefs, and an Increased perception of sex 
discrimination on the part of students as a result of 
taking a women's studies course. It uncovered "no 
changes in dislike or distrust of women or in career 
plans stemming from the course. Shueman and Sedlacek 
(1976) found increased "awareness" of sex roles and 
the "situation" of women as the result of taking 
women 'r7»tudles courses. ^ 

Several of the researchers have reported that the 
greatest change* occur among women students who have 
the most traditional attitfudes. BtuWi et al. (1978) 
found that, for the rest itn their samjA^^he women's 
studies course served to yfclarify and strengthen prior 
beliefs and to equip thfem with the information and 
intellectual* skills to use the course effectively, 
f ■ «■ 

JOn the whole, the research that utilized student 
self-reporting and student ratings found that women^s 
studies courses acljleve their goals and that students 
judge these courses as having a powerful Impact on 
their llV€U5 and educations. 

* • 

It is a major question to tfhat extent the bulk of 
the research reported to date. experimental design 



studies bears on the issues , of cognitive learning 
and hence on how comprehensively the Issues of 
teaching effectiveness In Wome^n's studies have been 
addtessed. With the exceptions of the attent\ion^ 
paid to^ ~ tliV ^eve^ cognitive ItRi lis an J tl^^^ 

acquisition of cognitive content in /the, exploratory 
and case study approaches^ and* of the report o£ 
studeiit appreciation of cognitive learning in Mangion^ 
and Wiersma (1974), the literature of evaluative 
research in vomen^s studle%,^Xends to be silent on the 
traditional academip goal of^ "intellectual mastery*" 

Finally, chronological ^review of the liteipature 
indicates that an* early trend toward assessing 
effectiveness almost exclusively in terms of attitude 
change has been supersede^, by a more multivariate 
approach. In thiis ^respect, the work of Talburtt et 
al. (1977), Elovson dnd Co^kcrof t (1977) , Davis et al. 
(1975-76), Kritek and Glaa8^( 1978) , and Register et 
al. (1978) is exemplary The Talburtt and Register 
studies are also^ noteworthy for their inclusion of 
teacher self --evaluation. 

Women's Studies ^Values and Teaching: 
Theory and Practice in the Classroom 

* 

In section 2, we discussed the process-product 
paradigm (Doyle, 1975/, which favors a bidirectional 
and multivariate model for assessing teaching effec- 
tiveness.^ The accounts of women's studies classrooms 
Ln' this subsection are preaented for the purpose of 
conceptualizing some of the var4hrt>les and interactive 
modes that obtain in women's studies teaching and 
learning as described by women s studies teachers. 
Issues of importance to future development, and hence 
to the future evaluation of women's'. sfiudies,^ are also 
raised. 

The Participant-Centered Classroom 

The theory behind the kind of women's studies 
teaching that .places the participants at the center 
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of the course argues that the most effective learning 
is active engagement with the materials and other 
sttfdents in the course. It argues a^lso that old, 
passive socialization and thought patterns can be 
"cfialTenged and new" p a^ te rns ^ralrtlahed through i:he 
direQt participation of' the student in the learning 

process* * 

%■ ' 

Howe (1970) describes a writing course fof women 
in which. she attempted to break the patterns of 
assumedMsftf^flority and dependency* on the teacher as a 
figure ofure^i6rit){^; that is, to overcome the barriers 
of in tel Actual domination and trivialization womea 
students often have encountered in their past edu$:a- 
tion. Howe faced squarely the issues of intrapsychic 
and 'interpersonal conflict engendered by the process. 
It 'is, she argued, a lo;ig step toward autonomy and 
power for the student and the teacher both to risk the 
anger and bewilderment of disruption, for what is 
being recbnstructed is not just students and their 
writing but the classroom itself* ^ 

Hoffman (1972), in describing a women's poetry 
course, argued for locating" the process of explicating 
texts in the students themselves, as a means of 
counteracting the negative content often found in the 
literature. Hoffman viewed, students and teachers 
reading together aff a socl,^Jt-act tha't in itself 
projects a community different from the patterns/' of 
isolation and despair found*in some of the women 
writers. Martyna (1976) suggcjsts that, in a cojirse 
that explores the. ways in which men ^nd womenluse 
language, the interactive classroom is an ideal afcena 
for students tb observe and begin to change thei^ own 
thought and speaking* patterns. J . 

The "talking classroom," ^^wever, is not without 
its attendant discomforts. Not only are discussions 
heated and personal (Talburtt^et a!., 1977), they 
often do not stick to the siifeject, a phenomenon of 
particular, although by no means exclusive, discomfort 
to* the teacher". Stizel (1977") reminds us that the 
classroom is qnly one component of a course. Dis- 
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\ cu88ion8» even when apparently lrr€ylevaat» cait 
'^revitalize memories^ alert* readers to mindsets Jthat 
8t;ruct;ure responsea^ ai\d raise and focus issues that 
become contexts'* for the readings writings and 

— — r- -dlaeusis^an of ^^eofcs t4vat go- on ou^^id^ the elas^* 

Proponents of the participant-centered classroom 
see it as the structured space is which teachers and 
students learn together to connect personal experience 
« to* the substance of books and to the larger issues and 
analyses' that " lie outside the^ classroom. '^his 
connecti,Qn» particularly in the. context of developing 
mutual trust and respect for women > is seen as a value 
in Itself and as a means of ensuring learning that has 
a context (Howe, 1977). 

Not all women's, studies teachers and students, 
however, rapturously embrace the personal and openr 
ended class'room discussion. Fireman (1973) noted that^ 
the^ ''emotional element" that she found running high in 
the history of women course she taught made con- 
centrating on the subject matter problematic. Krltek 
and Glass (1978) reported that some of their students 
were disconcerted by what they perceived as a lack of 
structure (authority) in that part of the course in 
which they were asked to take greater initiative for 
tljeir own learning. Davis (1978) described a pro- 
tracted struggle in a research seminar between the 
students' request to be "mothered" during tlie process 
^and her own conflicting Impulses to mother and |:o 
demand student independence. Such accounts raise two 
issues that have not been systematically investigate: 
the prior training and background of students and 
teachers in women's studies, and the contexts from 
which they ^ " 

Among those women' s studies teachers whose 
backgrounds, pedagogical preferences, and course 
objectives favor the participant-centered classroom, 
there is growing awareness that certain goals do not 
just happen spontaneously. ^ These Include: mutual 
respect , trust , and communlt)|r ; a shared leadership. 
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between students and teachers; cooperative prgjects; 
integration of affective and cognitive learning; and 
the integration of theory and action* ' Trana^latlng 
goals from rhetoric to teaching and learning InVplves 
building skitls mid dedltration in the class room a«d a 
continued understanding of why this is important 
(Schneiderwind, 1978-79)* ^ 

Thfe ^Content-Centered Classroom 

The content-centered classroom is not necessarily 
, . synonymous with the lecture-cetitered classroom, nor 
does it necessarily imply that the teacher is the 
cen^ter of the course* Values and objectives may 
overlap with those of the participant-centered class- 
room, particularly the connections lAade between 
personal experience and subject mattfer* As. Stoper 
observes, the emotional .engagement of teachers and ^ 
students in the content and processes of any course in 
> women's studies mu^t be combined ^ith "sensitivity" in 
structuring classes to make the emotionaX engagement a 
"powerful intellectual asset#" 

, Lectures, however, are a necessity in many lar^e 

courses, and they are often viewed as the most 
effective means for concisely conveying large and 
complex bodies of khowledge, as well as for demon- 
strating paradigm-challenging and feminist forms ^f 
argumentation and approaches- to content (Wolf, 1978). 
The lecture format may also be seen as a vehicle for 
p-resenting strong role mododr^ for women students, 
particularly with respect to Scholarship and the 
professions. Finally, from the perspective of the 
^ ^responsibilities that women's studies teachers feel 
^ for both subject matter and students, the lecture 
may be seen as. a format that. clearly delineates 
the function of the teacher as a person who can- 
not solve specific problems of decisionmaking in 
V students' lives^,^ but who can offer the broad context 

and analysis of where inequalities and oppression 
come, from in institutions, culture, and society 
(Eileenchild, 1979). , ^ 
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Because .the lecture-^discussl^ format is tradi- 
tional in higher education, itTias received less 
atten-eion in the published and informal literature on 
women^s studies teaching. Essays in the Sociologists 
for Women in Sod^^^ TJuTy " 1^7?) , howpef , 

address feminist, interdisciplinary, and pedagogiqal 
perspectives relevant to the lecture-discyss ion 
format* "Of particular note are the essays that 
describe the objectives of developing the "conceptual 
tools necessary to articulate [personal] understanding 
in structural terms" of discussion grounded in course 
lectures and readings (Gould, p. 4); of helping 
students to identify the ways in which 'they contribute 
to. the •maintenance of ses^ual inequality ; and of 
encouraging equal participation even in large lecture 
classes (Thorne and Parrlngton, pp. 10-11). 

Transitions in Women'^s Studies Classrooms 

Stoper speaks ,to several J.ssues that are im- 
portant variables in understanding the changing 
objectives that mighf occqr in women's studies class- 
rooms* She describes, 'for instance, the rationale 
behind abandoning small group discussions that lacked 
the intimate, voluntary setting essential for theitf 
success. Stoper also reports that the growing body of 
findings on the status of women i<i her field of 
political science has led her to adopt a less inter- 
disciplinary approach in her political scieftce women^s 
studies course. On the other hand, the growing mass 
of material in other* areas as well has Ued her to 
participate in a team-taught, interdisciplinary course 
in non-American history, literature, and philosophy 
that was enthusiast lc^4-ly received. 

r ■ 

Course objectives may change for other reasons. 
As the field develops and programs have' the 'resources 
to expand and differentiate offerings, courses and 
their objectives become distinguished by kind or 
level of specializati6n. And as some of the * litera- 
ture reviewed in the previous subsection suggests, 
consciousness has already been raised arid sex-role 
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attitudes and stereotyping changed, - at ^ least _among^ 

some women^s studies students and particularly, among 

students who become in^jors 6r concentrators ♦ 

« 

Finally, Sqjjie of lEtie pubfls^ and ihfdfmal 
literature on vomen^s studies teaching xalses Issues 
that bear upon future evaluation of teaching effec-* 
tlveness in this evolving field. Whether cjtianged 
consciousness, occurs before a student takes a vomen^s 
studies course, during that course, or as a delayed 
reaction to the course, teacl^ers face helping students 
with "transformed values'* to \lve and work productive- 
ly in a society whose yalues have not undergone 
radical transformation. 

> 

To paraphrase Morgan ( 1978) , teachers-1 cannot 
alienate students from their culture and lea\^ them 
there, but must use the accumulated knowledge of 
Interdisciplinary studies to help students in gain- 
ing a better understanding of the process of aliena- 
tion and of how to deal wlffh it. Hersh (1^979) 
advocates teaching the sociology and psychology of 
role change as part of the course or curriculum, and 
Morgan suggests examining the historical behavior of 
oppressed groups and ti\e dynamics of individuals anS 
society In transition. Arpad and Arpad (1979) propose 
building into a women ""s studies course an examination 
of consciousness Itself as a way of helping students 
medj-ate between their own past and present id'entitles. 
They suggest that this be done by reviving and 
revitalizing the old peda|:gogical strategy of p'hllo- 
jsoptiic Inquiry into the nature 6t things. 



Summa 



Our overall impression from the published and 
ifffprmal literature is that women's studies is 
feminist, at least in this sense: women's studies 
s tudents and teachers strive in the ideal to make 
their classes a mediaj:lon between yhat has been and Is 
and what is anjd what might be. This process of 
simultaneously studying the past and present and 




making a future/ characterizes the state of women's 
studies knowledjie itself. In this evolutionary and 
hypothetical stage, it is clear that any evaluation of 
teaching eff ectiy^eness in women's^ studies must ^j;ake 
into ac coun t the mul t, ivar|,«t?i ^chb^t^gi^ a^|>d; ^ bflj^c?-, 
tlonal nature of the fie^d.' * St'iide^ks- af£e<*t 't^^ft^ 
teachers affect students, and both affect the aXAtij^^i'^ 
knowledge' itself . . 




5. COHCLUSIONS AND RECOMMENDATIONS 



In our concluslpns and recommendations, we 
propose both long- and short-term goals ^ for research 
on teaching "la women's studies and, for the evaluation 
and improvement of teaching ,ef fee tlveness^ 



Women's studies is a major innovation and reform 
In education, and women's studies teaching deserves 
b6th basic and applied research. Resear^ch that is 
directed toward understanding the relationships 
between variables that obtain in teaching and learning 
would provide a knowledge base from which research 
that is applied, problem-solving, and evaluative could^ 
optimally develop. 

As stated in section 1, women's studies courses 
and programs issue from several different educational 
traditions have differing or multiple objectives. 
They are further complicated, from the perspective of 
research, by the overlay of feminism and the inter- 
disciplinary nature of some of the courses. 

A. 

Given these considerations, we recommend that 
further- research on teaching take into account^the 
complex variables and paradigms outlined tn section 2. 
To our knowledge, research based on the multivariate 
and bidirectional models has not addressed itself 
specifically to women's ^studies courses or programs. 
Many crucial questions about the relatlonsfrtp between 
effective teaching in women's studies and effective 
teaching in both traditional and innovative^ fields 
remain to be investigated. 

In the ^hort run, the inductive, ob8ervati/>nal»^ 
case study t^approach^ combined with experimental 
research, s'eems the most suitable methodology for 
determining the complex variaBle«k^ women's studies 
teaching and learning. Indue tl^fe--Ar case study 
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research has the advantage^ as Doyle (1975) points 
out, of generating hypotheses that can be further 
refined and tested by experimental research^ It is 
ou r asses sment of the experimental research tn women's 
studies to date that it. has not so much failed to asU 
the right ^uesfilons, but that the line of questioning 
has not been comprehensive enough and has been overly 
focused on attitude chbnge* In addition, measuring' 
devices have not been particularly sensitive* 

On the other hand, we found the study of Talburtt 
et al* very useful in tferms of understanding the 
impact of different kinds of women's educational 
programs* The impact studies, however, do not 
necessarily explore the specific dynamics of teaching 
and learning in any given course or program* ^ Aa 
women's studies/teachers, we found the case study work 
of Davis et al*, Kritek and Glass, and Register et al* 
most useful* Because each approach, by itself, has 
limitations, we favor a combination of inductive/ 
exploratory, case study, and experimental methods in 
future research on teaching in women's studies* 

Furthermore, the experimental researchers whose 
work did not detect statistically significant mean 
score changes in attitude after one term of a women's 
studies course call for longitudinal^ studies* The 
research that does not find changes in group scores 
does find changes in individual scores attributable to 
paving taken a women's studies course* The explora- 
tory research of Talburtt and Elovson determined that 
women's studies courses have impact over time both on 
individuals and on groups* ^ We recommend, therefore, 
that research undertaken to determine cognitive and 
affective changes in students as the result of taking 
women's studies courses should assess both individual 

and group scores and should be longitudinal* 

♦ *• 

To begin develoj[>ing a comprehensive and sys- 
tematic knowledge and tlata base, we suggest that four 
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kinds of women's sfUdles courses recjpive Intensive 
attention in future research^ with particular emphasis 
on cognitive learning: I 



1. A lower-division introductory course^ 
such as "Introduction to Women's 
Studies" or "Women in. Contemporary 
Society." 

2. An upper-division discipline-centered 
course aimed primarily Ht mastery of t.he 
subject matter and development of Skills 
of scholarship and critical thinking and 
analysis; for example^ "Psychology of 

^ Women," 'Vomen and the Law," or "Earlier 
American Women Writers." 

3. An upper-division interdisciplinary or 
inj^egrative course, such as "Feminism: « 
Theory and Practice" or "Wo^en in a 
Cross-Cultural Perspective." 

4. A skills acquisition course, such >as 
"Women in Management" or "As8ertivene38 
Training." 

In keeping with Biddle's emphasis on the impor- 
tance of the institutional or cooMminity context and 
Talburtt's emphasis on the diffj^rent . institutional 
realities of women's studies, we TecQjmmend that" these 
four types of courses be syste^tically examined in 
five different institutional /settings: a jlarge, 
state-supported university ;^ a middle-slzedl urban 
institution (either public or private); ai small 
liberal arts college; and a community collipge. \ 

i 

In a|idition to the variables of teachlltig and 
learning considered in any research on teiaching 
effectiveness, several Issues specific to women's 
studies need to b^ considered. These are dlscussecf 
below. 
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f Feminism and Teaching Effectiveness 

A high proportion of the tedchei^ who responded 
to our survey (see appendix) agree that feminist or 
feminist-humanist approaches to teactllrig exist In' 
terms of subject matter, relations in the classroom, 
and general mindset. In addition, some experimental 
research has concluded that the presence of a feminist 
in the classroom does make a dlffei:ence, particularly 
for women (Blumenhagen^ 1^74^ Thamesj^ 1975; jCoff man, 
1978; Farley, 197^8). Research should be undertaken to 
determine the variables of teaching and learning that 
are Influenced by feminist or feminist-humanist 
approaches in teaching. 

Interdisciplinary Approaches 
And Teaching Effectiveness 

We have been unable to locate experimental 
research that assesses the relationship, if any, 
between an interdisciplinary approach to Subject 
matter and teaching effectiveness. Baxter (1974) 
hypothesizes that, the interdisciplinary women's? 
studiesa^iM^oach uncovers a conflict-ridden dialectic 
between women and culture. The structure 6f the 
subject (Bruner, 1963) and the organization and design 
of the subject matter (Davis, 1977) influence learning 
outcomes. Implications of the interdisciplinary 
approach for teaching effectiveness in women's studies 
should be investigated. 

Formative Experiences of Women's Studies 
Teachers and Teaching Effectiveness 

Research should be initiated on the formative 
educational and life experiences of women'a studies 
teachers. We are concerned with the relative impact 
of the formal academic background of • wonjen's studies 
teachers in an interdisciplinary as opposed to a 
discipline-specific course, as well as with the 
relation pf these variables to the question of effec- 
tive teaching. Information of this nature bears 
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IVQiportaatly on ^ the developpient fijxd revision^ of the 
women's studies curricula at • both the^ undergraduate 
and the graduate le\^ls» particularly as curricula are 
-jMUr^M^ed ^ the-p^^P^^^^^tlo n -o£— future- teachera^ 



♦ ''Sex of Instructor and Student 
And chins Effectiveness 

-7i :~ ^ 

Further research Is needed to test the con- 
elusions of McKeachle ^et al* (1971), ^Ferber fiynd Huber 
(1976), Harris (1976), and Kashak (1978) regarding^ the 
sex of the Instrtictbr, the sex of the student, and 
sexism within the context of the "Women's studies 
clasdrootf. We are also concernedf about the extent to 
which the learning and^' cognitive styles of . females 
should be considered In the design of ^research 
conducted- to assess learning outcomes and teaching 
effectiveness* 

In the long run, research must be un^ettaken to 
^ develop appropriate and sensitive measures of learning 
that can assess multiple course obj^tlves. Including 
changes In attitude, resoclalization of relationships 
In the classroom, mastery of subject matter, critical 
thinking, acquisition of skills, and the/lntegratlon 
of these objectives into effective teaching and 
learning. As Scott (1975) notes, one of the njiajor 
problems In research on teaching has been' the lack of 
adequate measures of student learning.'^ 

Two additional concerns need to be addressed* 
Who might do the suggested research? To what uses 
might results be put? 

It Is our opinion "th-^t research on teaching In 
women^s studies would best be conducted by teams of 
Individuals who come from women^s studies and from ^he 
various disciplines associated with educational 
research* We think that initiating and developing 
working relationships between educational researchers ' 
and women's^ studies practitioners would be of mutual 
benefit to both; it would enhance the probability 
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that the important . questions are asked and that 
the results are interpreted and disseminated in 
an ^appropriate nmnner. Women's studies students, 
teachejfs, and administrators have nvuch to learn 
from educational r^earchers , just as educational 
researchers have much to learn from women's studies 
students, tethers, a^d administrators* 

If the object of research is to provide informa- 
tion and, understanding about the nature of a par- 
ticular phenomenon, research findings should not be 
used for evaluative purposes, other than in the 
formative mode* Results of research should not be 
used for advocacy or nonadvocacy in any particular 
jwomen's^ studies program. Participants 'must be 
guaranteed the protection „^iven other subjects of 
research. 

The research suggested above is of critical 
importance not only for understanding teaching 
effectiveness in women's studies, but for under- 
standing mo re^ about the education of women in general. 
Th^ classroom is the heart of educational change, and 
understanding more about women as teachers and 
learners will be of use to those concerned with 
providing, equal educational qji^<?rtunity for women both 
inside and outside of women's studies. 

Evaluation and Improvement of Teaching 

As stated in section 3 of this monograph, ye 
agree with the AAUP position paper that toultiple 
measures must be used ^to evaluate teaching. Ideally, 
before proceeding with te commend at ions for'the evalua- 
tion of teaching, one should wait until sensitive and 
appropriate measures of student learning are developed 
Qnd tested and until a knowledge and data base his 
provided criteria of effective teaching in various 
kinds of women's studies courses. However, women's 
studies practitioners are faced' with immediate 
needs for information on which*to make per^p^fnel, 
curricular, and program decisions. ^'^'^^^ 

« • 
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Despite the problems with the validity and 
usefulness of students^ ratings described in se^tibti 
3, 94 percent of qur questionnaire respondents 
indicated, that their courses are being regularly / 
evaluated using student rating fl>rins of college or 
university design, women's studies design, ori both* 
' Thirty-nine percent indicated that they are feither 
neutral or dissatisfied with their current evaluation 
instrument. In this sense , women's studies teachers 
are in the saue predicament as most other teachers in 
higher education (Cross, 1977) • 

As a first step, we recommend that funds be made 
available' to those prograjq^s that wish to analyze 
evaluative data collected previously* Women'es studies 
programs are underfunded, and preliminary analysis 
will not be possible for most progr^s without outside 
assistance* T|ius, techrtical assistance should be made 
available, as necessary, to programs involved in data 
analysis* 

/ 

In addition to data analysis, efforts should 
be^ made to factor-analyze and refine evaluation 
instruments* After preliminary work is completed by 
programs, the National Women's , Studies Association 
should systematically collect and analyze student 
rating forms from all women's studies programs where 
such forms are in use, and begin the process of 
determining the- criteria f6r evaluating effective 
teaching in various types of women's fetudies qourses* 
Sample forms should be made available withotit cost to 
programa and individuals* , ^ 

As a second^ step, we re(!tommend that in-service 
workshops on the evaluation of teaching be"^ conducted 
for women's studies students, teachers, and admlnis- 
"^trators* Workshops should include theoretical issues 
in the evaluation aj^d improvement of teaching, instru- 
ment selection, methods for systematic^^lly collecting 
data (including both student and instructor self- 
report data), data analysis, and the interpretation 
and dissemination of results* 




Thirds we recommfend that the p>fticipant8 
and leaders of the evaluation workshops develop a 
' resource/guidebook for those individuals; who arig^ 
una^ te tir-p^r±c ipa:tB ~ tTr~ -ytrrk sho p s ^ Ag^^i^ 
theftreticalT and methodological issues should be 
covered, as wS^ll as sample evaluation instruments and 
resources far technical assistaijce. 

Finally, we are in agreement with Davis (1977) 
that the desigif and organization of a course is an 
-important variable in effective teaching. • In-service 
course and curriculum design workshops should be made 
available on a regional basis to women's studies 
student! , teachers, and administrators. The focus 
should include both discipline-centered and interdis- 
ciplinary courses and curricula, with attention given 
to teaching methodologies and course design. 

To this end, we recommjjid that the National 
Women's Studies Association TOvelop and maintain a 
clearinghouse for course outlines and bibliographies.' 
'As Gerda Lerner <^as noted (1979), the willingness of 
women's studies teachers to share course outlines and 
bibliographies with each/other has advanced the field 
more 'rapidly than .otherwise would have been possible. 
We urge that, whenever possible, course outlines and 
bibliographies be submitted to the clearinghouse 
with both instructor and student evaluations. Such 
informatibn would greatly assist individuals in 
refining arid improving course design. 

In 8um» the relationship between educational 
research and educatJ.onal practice must be bidirec- 
tional. The progress of research on teaching sug- 
gested in the previous subsection ;depends on both 
e>ie .information and insights of women's studies 
practitioners. , If evaluative informatlpn is collected 
and analyzed in a systematic manner, and if opportuni- 
ties are available far improving course design and 
teaching methods, the probability of maintaining and 
improving effective- teaching will be enhanced in any 
particular program. Further, the information provided 



by practitioners will ensure that researchers direct 
their lines of questioning to those Issues and 
concerns that Are of Importance to practitioners • 
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APPENDIX 



The followlftg Is a se^ectlcm 0f response^^ oar 
survey of values in women's Studies teaching.* Out 
of 285 jprograms contacted^ 143 responded. Three 
individual teacher responses were counted maximally 
per institution. N * thfe number of individual women's 
studies teacher responses per question. 







Str&ngly 
Aflraa ♦ _ 


A^ree 


Mautral 


Oiaaqree 


Strongly 
Disagree 


Couraa content ahould 
ralata dirsctly to 
stud«nt livas 


2S6 


49% 


41% 


71 


^ 3% 




Course content should b« 
oonoeriMd pri»»rily with 
tha aubjaot Mtter 


243 


341 


54% 


4% 


7% 


1% 


lUnn«r or styl* ot 
tMchir>9 is impor- 
tant ai what ia taught 


256 


511 


341 


9% 


6% 




Couraaa ahould contribute 
to paraonal 9rowth o£ 
atudAta 


257 


fi^l 


2t% 








C^raaa should contribute 
to aoquiaition of 
intellaotiial akilla 


258 


\ 


31% 


11 






Couraaa should contribute 
to political developeient 
of atudanta 


25C 


3«1 \ 


37% 


23% 


2% 





Of the 50 percent (N«125) who indicated that 
their values in women's studies teaching 'had changed 
since they began (total is less than 100 percent): 

30 percent (N"34) said they value student 
capacities » interaction, personal growth, 
and group process in the classroom 
more; 

35 percent (N«39) said they value intel- 
lectual rigor, cognitive^ content , and 
skills of learning more. - 



*The survey of women's studies teachers was intended 
to aid in the preparation of this planning study. 
The authors make no claims to original or scientific 
research. 



I 

/ Of thi'eS percent (N-169) who indicated agreement 

^ With 'the':t!te^ent that feminist teacUing styl^^ or 
approaches exist (total is more than 100 percent). 



- 54 percent (N-89) mentioned feminist.- 
perspectives on classroom process and 
organization; 

- 22 percent <N-36) mentioned feminist 
approaches to subject matter; 

- 20 percent (N-34) mentioned explicit 
connections between personal experience 
and reading materials; 

- 16 percent (N-26) mentioned validating 
humanistic qualities in subject matter 
pedagogical style, and how students are 
regarded; 

_ ^4 percent (N^24) mentioned focus on 
women's experience, values, eontribu- 
tions. and relationship of course con- 
tents to; feminist issues, including class 
and race; 

- 12 percent (N-20) mentioned openness to 
dialogue.^ challenge-, and . new ideas; 

- 21 percfent (N-35) listed other attri- 
bates. 

some 94 percent (N-239) of the respondents indl- 

»ith current evaluation techolques, 60 Percent 
indicated satisfaction or "rong satis- 
^wi-^x; ^ /mdq\ i t\Ai rated neutrality 

faction; 39 P"^^'^^ J^-^'^./eett: indicated 
or dissatisfaction; and 1 percent v« 

strong dissatisfaction. . / 
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